Jun 15 04:08:38 devstack cinder-volume[81215]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:08:38 devstack cinder-volume[81215]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:08:38 devstack cinder-volume[81215]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:08:39 devstack cinder-volume[81215]: INFO dbcounter [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Registered counter for database cinder
Jun 15 04:08:39 devstack cinder-volume[81215]: DEBUG oslo_db.sqlalchemy.engines [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:08:39 devstack cinder-volume[81215]: DEBUG dbcounter [-] [81215] Writer thread running {{(pid=81215) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 04:08:39 devstack cinder-volume[81215]: INFO cinder.rpc [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 15 04:08:39 devstack cinder-volume[81215]: INFO cinder.rpc [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 15 04:08:39 devstack cinder-volume[81215]: DEBUG oslo_db.sqlalchemy.engines [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:08:39 devstack cinder-volume[81215]: INFO cinder.volume.manager [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Determined volume DB was empty at startup.
Jun 15 04:08:39 devstack cinder-volume[81215]: DEBUG cinder.volume.manager [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81215) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 15 04:08:39 devstack cinder-volume[81215]: INFO cinder.volume.manager [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 15 04:08:39 devstack cinder-volume[81215]: WARNING stevedore.named [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 04:08:39 devstack cinder-volume[81215]: WARNING castellan.key_manager [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:08:39 devstack cinder-volume[81215]: WARNING cinder.keymgr.conf_key_mgr [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:08:39 devstack cinder-volume[81215]: DEBUG cinder.volume.drivers.lvm [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81215) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 15 04:08:39 devstack cinder-volume[81215]: DEBUG oslo_concurrency.processutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81215) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_concurrency.processutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] CMD "cinder-rtstool verify" returned: 0 in 0.373s {{(pid=81215) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_db.sqlalchemy.engines [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:08:40 devstack cinder-volume[81215]: INFO cinder.rpc [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 15 04:08:40 devstack cinder-volume[81215]: INFO cinder.rpc [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 15 04:08:40 devstack cinder-volume[81215]: WARNING stevedore.named [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 04:08:40 devstack cinder-volume[81215]: WARNING castellan.key_manager [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:08:40 devstack cinder-volume[81215]: INFO cinder.volume.manager [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_db.sqlalchemy.engines [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81215) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:08:40 devstack cinder-volume[81215]: INFO oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Starting 1 workers
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Started child 81388 {{(pid=81215) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Full set of CONF: {{(pid=81215) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] ******************************************************************************** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Configuration options gathered from: {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] ================================================================================ {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] allow_availability_zone_fallback = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] allow_compression_on_image_upload = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] allowed_direct_url_schemes     = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] api_rate_limit                 = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] auth_strategy                  = keystone {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] az_cache_duration              = 3600 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_availability_zone      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_host                   = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_name                   = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_stats_polling_interval = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backup_api_class               = cinder.backup.api.API {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backup_name_template           = backup-%s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backup_use_same_host           = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backup_use_temp_snapshot       = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] chap_password                  = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] chap_username                  =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_internal_tenant_project_id = ca925d1a1aa2453bbcb42accaf2b1b33 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_internal_tenant_user_id = fa70387b81fc4027b4cad8319d0151e3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cloned_volume_same_az          = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cluster                        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] compression_format             = gzip {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] compute_api_class              = cinder.compute.nova.API {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81388]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] config_dir                     = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] config_source                  = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] control_exchange               = openstack {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] debug                          = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] default_availability_zone      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] default_group_type             = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] default_volume_type            = lvmdriver-1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] disk_geometry                  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] driver_client_cert             = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] driver_client_cert_key         = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] driver_data_namespace          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] driver_ssl_cert_path           = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] driver_ssl_cert_verify         = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] driver_use_ssl                 = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] enable_force_upload            = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] enable_new_services            = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] enable_unsupported_driver      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] enforce_multipath_for_image_xfer = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] filter_function                = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_api_insecure            = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_api_servers             = ['http://192.168.122.199/image'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_api_ssl_compression     = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_ca_certificates_file    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_catalog_info            = image:glance:publicURL {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_certfile                = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_keyfile                 = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_num_retries             = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance_request_timeout         = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] goodness_function              = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] graceful_shutdown_timeout      = 5 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] group_api_class                = cinder.group.api.API {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] host                           = devstack {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_compress_on_upload       = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_conversion_address_space_limit = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_conversion_cpu_limit     = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_conversion_disable       = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_upload_use_cinder_backend = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_upload_use_internal_tenant = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_volume_cache_enabled     = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_volume_cache_max_count   = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] image_volume_cache_max_size_gb = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] init_host_max_objects_retrieval = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] instance_format                = [instance: %(uuid)s]  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] iscsi_target_flags             =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] iscsi_write_cache              = on {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] iser_helper                    = tgtadm {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] iser_ip_address                = 192.168.122.199 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] iser_port                      = 3260 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_color                      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_config_append              = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_dir                        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_file                       = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_options                    = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_rotate_interval            = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_rotate_interval_type       = days {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] log_rotation_type              = none {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] max_age                        = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] max_logfile_count              = 30 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] max_logfile_size_mb            = 200 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] max_over_subscription_ratio    = 20.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] message_reap_interval          = 86400 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] message_ttl                    = 2592000 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] migration_create_volume_timeout_secs = 300 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] monkey_patch                   = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] monkey_patch_modules           = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] my_ip                          = 192.168.122.199 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] no_snapshot_gb_quota           = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] num_iser_scan_tries            = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] num_shell_tries                = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] num_volume_device_scan_tries   = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] nvmeof_conn_info_version       = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] nvmet_ns_id                    = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] nvmet_port_id                  = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_max_limit                = 1000 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_volume_ext_list          = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_volume_listen_port       = 8776 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_volume_use_ssl           = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] osapi_volume_workers           = 2 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] per_volume_size_limit          = -1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] periodic_fuzzy_delay           = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] periodic_interval              = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] public_endpoint                = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] publish_errors                 = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_backup_gigabytes         = 1000 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_backups                  = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_gigabytes                = 1000 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_groups                   = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_snapshots                = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] quota_volumes                  = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] rate_limit_burst               = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] rate_limit_except_level        = CRITICAL {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] rate_limit_interval            = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] reinit_driver_count            = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] replication_device             = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] report_discard_supported       = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] report_interval                = 120 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] reservation_clean_interval     = 86400 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] reservation_expire             = 86400 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] reserved_image_namespaces      = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] reserved_percentage            = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] rpc_response_timeout           = 120 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] run_external_periodic_tasks    = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] scst_target_driver             = iscsi {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] scst_target_iqn_name           = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_down_time              = 720 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] shell_completion               = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] snapshot_name_template         = snapshot-%s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] snapshot_same_host             = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] split_loggers                  = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] state_path                     = /opt/stack/data/cinder {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] storage_availability_zone      = nova {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] storage_protocol               = iSCSI {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] syslog_log_facility            = LOG_USER {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] target_helper                  = lioadm {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] target_ip_address              = 192.168.122.199 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] target_port                    = 3260 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] target_protocol                = iscsi {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] target_secondary_ip_addresses  = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] trace_flags                    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] transport_url                  = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] until_refresh                  = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_chap_auth                  = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_default_quota_class        = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_journal                    = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_json                       = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_multipath_for_image_xfer   = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_stderr                     = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] use_syslog                     = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] verify_glance_signatures       = enabled {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_api_class               = cinder.volume.api.API {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_backend_name            = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_clear                   = zero {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_clear_ionice            = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_clear_size              = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_copy_bps_limit          = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_dd_blocksize            = 1M {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_name_template           = volume-%s {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_service_inithost_offload = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volume_usage_audit_period      = month {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] zoning_mode                    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_concurrency.disable_process_locking = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: INFO cinder.volume.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.admin_password = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.admin_token = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.admin_user  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_port   = 35357 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_protocol = https {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_section = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_type   = password {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_uri    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.auth_version = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.cache       = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.certfile    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.identity_uri = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.include_service_catalog = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.insecure    = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.interface   = public {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.keyfile     = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_password =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcache_username =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.region_name = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.service_type = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.199/identity {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.backend                  = dogpile.cache.null {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.backend_argument         = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.backend_expiration_time  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.config_prefix            = cache.oslo {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.debug_cache_backend      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.enable_retry_client      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.enable_socket_keepalive  = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.enabled                  = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.enforce_fips_mode        = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.expiration_time          = 600 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.hashclient_retry_attempts = 2 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_dead_retry      = 300 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_pool_maxsize    = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_sasl_enabled    = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.password                 = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.proxies                  = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.redis_db                 = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.redis_server             = localhost:6379 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.retry_attempts           = 2 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.retry_delay              = 0.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.socket_keepalive_count   = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.socket_keepalive_idle    = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.socket_keepalive_interval = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.socket_timeout           = 1.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.tls_allowed_ciphers      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.tls_cafile               = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.tls_certfile             = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.tls_enabled              = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.tls_keyfile              = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cache.username                 = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.asyncio_connection    = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.asyncio_slave_connection = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.backend               = sqlalchemy {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.connection            = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.connection_debug      = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.connection_parameters =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.connection_recycle_time = 3600 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.connection_trace      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.db_inc_retry_interval = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.db_max_retries        = 20 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.db_max_retry_interval = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.db_retry_interval     = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.max_overflow          = 50 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.max_pool_size         = 5 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.max_retries           = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.mysql_wsrep_sync_wait = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.pool_timeout          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.retry_interval        = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.slave_connection      = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.sqlite_synchronous    = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.synchronous_reader    = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] database.use_db_reconnect      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.connection_string     = messaging:// {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.enabled               = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.es_doc_type           = notification {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.es_scroll_size        = 10000 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.es_scroll_time        = 2m {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.filter_error_trace    = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.hmac_keys             = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.sentinel_service_name = mymaster {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.socket_timeout        = 0.1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.trace_requests        = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler.trace_sqlalchemy      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler_jaeger.process_tags   = {} {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler_jaeger.service_name_prefix = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] profiler_otlp.service_name_prefix = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.enforce_new_defaults = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: WARNING oslo_config.cfg [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.enforce_scope      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.policy_default_rule = default {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.policy_file        = policy.yaml {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] coordination.backend_url       = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.group          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.helper_command = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] privsep_osbrick.user           = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.group         = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.helper_command = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] cinder_sys_admin.user          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.auth_section      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.auth_type         = password {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.cafile            = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.certfile          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.collect_timing    = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.insecure          = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.keyfile           = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.send_service_user_token = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.split_loggers     = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] service_user.timeout           = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.auth_section            = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.auth_type               = password {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.certfile                = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.collect_timing          = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.insecure                = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.keyfile                 = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.region_name             = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.split_loggers           = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] glance.timeout                 = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.backend_availability_zone = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.chap_password = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.chap_username =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.disk_geometry = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.driver_client_cert = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.driver_client_cert_key = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.driver_data_namespace = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.driver_use_ssl = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.extra_capabilities = {} {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.filter_function = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.goodness_function = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.iscsi_target_flags =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.iscsi_write_cache = on {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.iser_helper   = tgtadm {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.iser_ip_address = 192.168.122.199 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.iser_port     = 3260 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.lvm_share_target = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.lvm_type      = auto {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.num_shell_tries = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.replication_device = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.report_discard_supported = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.reserved_percentage = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.target_helper = tgtadm {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.target_ip_address = 192.168.122.199 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.target_port   = 3260 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.target_protocol = iscsi {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.trace_flags   = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.unique_fqdn_network = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.use_chap_auth = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_backend_name = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_clear  = zero {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_clear_ionice = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_clear_size = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_reports.file_event_handler = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_reports.log_dir           = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack sudo[81400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.backend_availability_zone = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.backend_host       = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.chap_password      = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.chap_username      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack sudo[81400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.disk_geometry      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.driver_client_cert = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.driver_data_namespace = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.extra_capabilities = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.filter_function    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.goodness_function  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.iser_helper        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.iser_ip_address    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.iser_port          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.iser_target_prefix = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.lvm_share_target   = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.lvm_type           = auto {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.num_shell_tries    = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.replication_device = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.report_discard_supported = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.reserved_percentage = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.scst_target_driver = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.storage_protocol   = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.target_helper      = lioadm {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.target_ip_address  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.target_port        = 3260 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.trace_flags        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.use_chap_auth      = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_clear       = zero {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_clear_size  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] lvmdriver-1.volumes_dir        = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.ssl      = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_notifications.driver = [] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_notifications.retry = -1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] key_manager.fixed_key          = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.barbican_api_version  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.barbican_endpoint     = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.barbican_endpoint_type = public {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.barbican_region_name  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.cafile                = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.certfile              = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.collect_timing        = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.insecure              = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.keyfile               = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.number_of_retries     = 60 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.retry_delay           = 1 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.send_service_user_token = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.split_loggers         = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.timeout               = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.verify_ssl            = True {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican.verify_ssl_path       = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.auth_section = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.auth_type = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.cafile   = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.certfile = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.collect_timing = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.insecure = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.keyfile  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.split_loggers = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] barbican_service_user.timeout  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.approle_role_id          = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.approle_secret_id        = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.kv_mountpoint            = secret {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.kv_path                  = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.kv_version               = 2 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.namespace                = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.root_token_id            = **** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.ssl_ca_crt_file          = None {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.timeout                  = 60.0 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.use_ssl                  = False {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:08:40 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] ******************************************************************************** {{(pid=81215) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 15 04:08:41 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.808s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:41 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:41 devstack sudo[81400]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:41 devstack sudo[81570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:41 devstack sudo[81570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:42 devstack sudo[81570]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.717s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:08:42 devstack cinder-volume[81388]: INFO cinder.brick.local_dev.lvm [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:42 devstack sudo[81764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:08:42 devstack sudo[81764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:42 devstack sudo[81764]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG cinder.brick.local_dev.lvm [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81388) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 15 04:08:42 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:42 devstack sudo[81964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:42 devstack sudo[81964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:44 devstack sudo[81964]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.374s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:44 devstack sudo[82172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:44 devstack sudo[82172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:44 devstack sudo[82172]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:44 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:44 devstack sudo[82183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 15 04:08:44 devstack sudo[82183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:45 devstack sudo[82183]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:45 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.888s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:45 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:45 devstack sudo[82187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:08:45 devstack sudo[82187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:46 devstack sudo[82187]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:46 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:46 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:46 devstack sudo[82192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:08:46 devstack sudo[82192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:47 devstack sudo[82192]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:47 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:47 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:47 devstack sudo[82195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:47 devstack sudo[82195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:47 devstack sudo[82195]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:47 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:47 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:47 devstack sudo[82200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:47 devstack sudo[82200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:48 devstack sudo[82200]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:48 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:48 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:48 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:48 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:48 devstack sudo[82207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:48 devstack sudo[82207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:49 devstack sudo[82207]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:49 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.929s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:49 devstack cinder-volume[81388]: INFO cinder.volume.drivers.lvm [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 15 04:08:49 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:49 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:49 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:49 devstack sudo[82243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:49 devstack sudo[82243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:50 devstack sudo[82243]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:50 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:50 devstack cinder-volume[81388]: DEBUG cinder.volume.drivers.lvm [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Updating volume stats {{(pid=81388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 04:08:50 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:50 devstack sudo[82331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:08:50 devstack sudo[82331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:50 devstack cinder-volume[81215]: DEBUG dbcounter [-] [81215] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81215) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:08:50 devstack sudo[82331]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:50 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:50 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:50 devstack sudo[82406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:50 devstack sudo[82406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:51 devstack sudo[82406]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:51 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:51 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:51 devstack sudo[82479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:51 devstack sudo[82479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:51 devstack sudo[82479]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:51 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.574s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:51 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:51 devstack sudo[82482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:51 devstack sudo[82482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:52 devstack sudo[82482]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:52 devstack cinder-volume[81388]: INFO cinder.volume.driver [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Driver hasn't implemented _init_vendor_properties()
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG cinder.volume.driver [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81388) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG oslo_db.sqlalchemy.engines [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG dbcounter [-] [81388] Writer thread running {{(pid=81388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG cinder.db.sqlalchemy.api [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Building query based on filter {{(pid=81388) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}}
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG cinder.image.image_utils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81388) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 15 04:08:52 devstack cinder-volume[81388]: INFO cinder.keymgr.migration [None req-186b29cc-9b98-4225-af99-7a1d579ea0a4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG cinder.volume.drivers.lvm [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Updating volume stats {{(pid=81388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 04:08:52 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:52 devstack sudo[82486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:08:52 devstack sudo[82486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:53 devstack sudo[82486]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:53 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:53 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:53 devstack sudo[82489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:53 devstack sudo[82489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:53 devstack sudo[82489]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:53 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:53 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:53 devstack sudo[82492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:53 devstack sudo[82492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:54 devstack sudo[82492]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:54 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:54 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:54 devstack sudo[82496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:54 devstack sudo[82496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:54 devstack sudo[82496]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:54 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:54 devstack cinder-volume[81388]: DEBUG cinder.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Notifying Schedulers of capabilities ... {{(pid=81388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:08:54 devstack cinder-volume[81388]: INFO cinder.volume.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Driver initialization completed successfully.
Jun 15 04:08:54 devstack cinder-volume[81388]: INFO cinder.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Initiating service 2 cleanup
Jun 15 04:08:54 devstack cinder-volume[81388]: INFO cinder.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Service 2 cleanup completed.
Jun 15 04:08:54 devstack cinder-volume[81388]: DEBUG cinder.service [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Creating RPC server for service cinder-volume {{(pid=81388) start /opt/stack/cinder/cinder/service.py:231}}
Jun 15 04:08:54 devstack cinder-volume[81388]: DEBUG cinder.service [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81388) start /opt/stack/cinder/cinder/service.py:237}}
Jun 15 04:08:55 devstack cinder-volume[81388]: INFO cinder.volume.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 15 04:08:55 devstack cinder-volume[81388]: DEBUG cinder.volume.drivers.lvm [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Updating volume stats {{(pid=81388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 04:08:55 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:55 devstack sudo[82503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:08:55 devstack sudo[82503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:55 devstack sudo[82503]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:55 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:55 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:55 devstack sudo[82507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:55 devstack sudo[82507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:56 devstack sudo[82507]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:56 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:56 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:56 devstack sudo[82510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:08:56 devstack sudo[82510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:56 devstack sudo[82510]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:56 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:56 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:08:57 devstack sudo[82513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:08:57 devstack sudo[82513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:08:57 devstack sudo[82513]: pam_unix(sudo:session): session closed for user root
Jun 15 04:08:57 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:08:57 devstack cinder-volume[81388]: INFO cinder.volume.manager [None req-d56b2a94-2a96-4f02-a05e-4be3afac039b None None] Driver post RPC initialization completed successfully.
Jun 15 04:09:07 devstack cinder-volume[81388]: DEBUG dbcounter [-] [81388] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:09:07 devstack cinder-volume[81388]: DEBUG dbcounter [-] [81388] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=81388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:09:32 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager._thread_info {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:09:32 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread count: 6 {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:09:32 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread info: [<_MainThread(MainThread, started 134273042231424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134272943990592)>, <Thread(Thread-3 (stat_writer), started daemon 134272930384000)>, <Thread(Rabbit-heartbeat, started daemon 134272936161984)>, <Thread(Thread-5 (_runner), started daemon 134272930988416)>, <Thread(Thread-7 (_runner), started daemon 134272931139392)>] {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:10:32 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:10:32 devstack cinder-volume[81388]: DEBUG cinder.volume.drivers.lvm [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Updating volume stats {{(pid=81388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 04:10:32 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:10:32 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:10:32 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:10:33 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Jun 15 04:10:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:10:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:10:33 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:10:33 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:10:33 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Jun 15 04:10:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:10:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:10:33 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:10:33 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:10:34 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Jun 15 04:10:34 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.588s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:10:34 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:10:34 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:10:34 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:10:34 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Jun 15 04:10:35 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:10:35 devstack cinder-volume[81388]: DEBUG cinder.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Notifying Schedulers of capabilities ... {{(pid=81388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:10:35 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager._thread_info {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:10:35 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread count: 6 {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:10:35 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread info: [<_MainThread(MainThread, started 134273042231424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134272943990592)>, <Thread(Thread-3 (stat_writer), started daemon 134272930384000)>, <Thread(Rabbit-heartbeat, started daemon 134272936161984)>, <Thread(Thread-5 (_runner), started daemon 134272930988416)>, <Thread(Thread-7 (_runner), started daemon 134272931139392)>] {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:11:07 devstack cinder-volume[81388]: DEBUG dbcounter [-] [81388] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:11:32 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:11:32 devstack cinder-volume[81388]: DEBUG cinder.volume.drivers.lvm [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Updating volume stats {{(pid=81388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 04:11:32 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:11:32 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:11:32 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:11:33 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Jun 15 04:11:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:11:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:11:33 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:11:33 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:11:33 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Jun 15 04:11:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:11:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:11:33 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:11:33 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:11:34 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Jun 15 04:11:34 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:11:34 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:11:34 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:11:34 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:11:35 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Jun 15 04:11:35 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:11:35 devstack cinder-volume[81388]: DEBUG cinder.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Notifying Schedulers of capabilities ... {{(pid=81388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:11:35 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager._thread_info {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:11:35 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread count: 6 {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:11:35 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread info: [<_MainThread(MainThread, started 134273042231424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134272943990592)>, <Thread(Thread-3 (stat_writer), started daemon 134272930384000)>, <Thread(Rabbit-heartbeat, started daemon 134272936161984)>, <Thread(Thread-5 (_runner), started daemon 134272930988416)>, <Thread(Thread-7 (_runner), started daemon 134272931139392)>] {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:12:32 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:12:32 devstack cinder-volume[81388]: DEBUG cinder.volume.drivers.lvm [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Updating volume stats {{(pid=81388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 04:12:32 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:12:32 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 04:12:32 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:12:33 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Jun 15 04:12:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:12:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:12:33 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:12:33 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:12:33 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Jun 15 04:12:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:12:33 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:12:33 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 04:12:33 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:12:34 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Jun 15 04:12:34 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:12:34 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:12:34 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 04:12:34 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:12:35 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Jun 15 04:12:35 devstack cinder-volume[81388]: DEBUG oslo_concurrency.processutils [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=81388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:12:35 devstack cinder-volume[81388]: DEBUG cinder.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Notifying Schedulers of capabilities ... {{(pid=81388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:12:35 devstack cinder-volume[81388]: DEBUG oslo_service.periodic_task [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] Running periodic task VolumeManager._thread_info {{(pid=81388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:12:35 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread count: 6 {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:12:35 devstack cinder-volume[81388]: DEBUG cinder.volume.manager [None req-8053369e-4a91-4058-b1fe-d85679682ee6 None None] thread info: [<_MainThread(MainThread, started 134273042231424)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134272943990592)>, <Thread(Thread-3 (stat_writer), started daemon 134272930384000)>, <Thread(Rabbit-heartbeat, started daemon 134272936161984)>, <Thread(Thread-5 (_runner), started daemon 134272930988416)>, <Thread(Thread-7 (_runner), started daemon 134272931139392)>] {{(pid=81388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:13:07 devstack cinder-volume[81388]: DEBUG dbcounter [-] [81388] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:13:16 devstack cinder-volume[81215]: INFO oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Caught SIGTERM, stopping children
Jun 15 04:13:16 devstack cinder-volume[81215]: DEBUG oslo_concurrency.lockutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Acquiring lock "singleton_lock" {{(pid=81215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:13:16 devstack cinder-volume[81215]: DEBUG oslo_concurrency.lockutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Acquired lock "singleton_lock" {{(pid=81215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:13:16 devstack cinder-volume[81215]: DEBUG oslo_concurrency.lockutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Releasing lock "singleton_lock" {{(pid=81215) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:13:16 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Stop services. {{(pid=81215) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 15 04:13:16 devstack cinder-volume[81215]: DEBUG oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Killing children. {{(pid=81215) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 15 04:13:16 devstack cinder-volume[81215]: INFO oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Waiting on 1 children to exit
Jun 15 04:13:20 devstack cinder-volume[81388]: DEBUG oslo_concurrency.lockutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Acquiring lock "singleton_lock" {{(pid=81388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:13:20 devstack cinder-volume[81388]: DEBUG oslo_concurrency.lockutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Acquired lock "singleton_lock" {{(pid=81388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:13:20 devstack cinder-volume[81388]: DEBUG oslo_concurrency.lockutils [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Releasing lock "singleton_lock" {{(pid=81388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:13:20 devstack cinder-volume[81388]: WARNING amqp [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 04:13:20 devstack cinder-volume[81388]: WARNING amqp [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 04:13:20 devstack cinder-volume[81215]: INFO oslo_service.backend._eventlet.service [None req-efd253dd-1db5-44d1-85e9-60a3232a231b None None] Child 81388 exited with status 0
Jun 15 04:13:22 devstack cinder-volume[91083]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:13:22 devstack cinder-volume[91083]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:13:22 devstack cinder-volume[91083]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO dbcounter [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Registered counter for database cinder
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_db.sqlalchemy.engines [None req-a43844fd-661b-477e-8ca5-067839551258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG dbcounter [-] [91083] Writer thread running {{(pid=91083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO cinder.rpc [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO cinder.rpc [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_db.sqlalchemy.engines [None req-a43844fd-661b-477e-8ca5-067839551258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO cinder.volume.manager [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Determined volume DB was empty at startup.
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG cinder.volume.manager [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91083) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO cinder.volume.manager [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 15 04:13:23 devstack cinder-volume[91083]: WARNING stevedore.named [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 04:13:23 devstack cinder-volume[91083]: WARNING castellan.key_manager [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:13:23 devstack cinder-volume[91083]: WARNING cinder.keymgr.conf_key_mgr [None req-a43844fd-661b-477e-8ca5-067839551258 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO cinder.volume.manager [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_db.sqlalchemy.engines [None req-a43844fd-661b-477e-8ca5-067839551258 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:23 devstack cinder-volume[91083]: INFO oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Starting 1 workers
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Started child 91304 {{(pid=91083) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Full set of CONF: {{(pid=91083) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] ******************************************************************************** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Configuration options gathered from: {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] ================================================================================ {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] allow_availability_zone_fallback = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] allow_compression_on_image_upload = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] allowed_direct_url_schemes     = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] api_rate_limit                 = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] auth_strategy                  = keystone {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_availability_zone      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_host                   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_name                   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_stats_polling_interval = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backup_api_class               = cinder.backup.api.API {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backup_name_template           = backup-%s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backup_use_same_host           = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backup_use_temp_snapshot       = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] chap_password                  = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] chap_username                  =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_internal_tenant_project_id = ca925d1a1aa2453bbcb42accaf2b1b33 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_internal_tenant_user_id = fa70387b81fc4027b4cad8319d0151e3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cluster                        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] compression_format             = gzip {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] compute_api_class              = cinder.compute.nova.API {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] config_dir                     = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] config_source                  = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] control_exchange               = openstack {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] debug                          = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] default_availability_zone      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] default_group_type             = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] default_volume_type            = QuobyteHD {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] disk_geometry                  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] driver_client_cert             = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] driver_client_cert_key         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] driver_data_namespace          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] driver_ssl_cert_path           = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] driver_ssl_cert_verify         = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] driver_use_ssl                 = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] enable_new_services            = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] enable_unsupported_driver      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] enabled_backends               = ['QuobyteHD'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] enforce_multipath_for_image_xfer = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] filter_function                = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_api_insecure            = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_api_servers             = ['http://192.168.122.199/image'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_api_ssl_compression     = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_ca_certificates_file    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_catalog_info            = image:glance:publicURL {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_certfile                = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_keyfile                 = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_num_retries             = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91304]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance_request_timeout         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] goodness_function              = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] graceful_shutdown_timeout      = 5 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] group_api_class                = cinder.group.api.API {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] host                           = devstack {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_compress_on_upload       = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_conversion_address_space_limit = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_conversion_cpu_limit     = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_conversion_disable       = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_upload_use_cinder_backend = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_upload_use_internal_tenant = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_volume_cache_enabled     = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_volume_cache_max_count   = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] image_volume_cache_max_size_gb = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] init_host_max_objects_retrieval = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] instance_format                = [instance: %(uuid)s]  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] iscsi_target_flags             =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] iscsi_write_cache              = on {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] iser_helper                    = tgtadm {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] iser_ip_address                = 192.168.122.199 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] iser_port                      = 3260 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_color                      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_config_append              = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_dir                        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_file                       = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_options                    = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_rotate_interval            = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_rotate_interval_type       = days {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] log_rotation_type              = none {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] max_age                        = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] max_logfile_count              = 30 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] max_logfile_size_mb            = 200 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] max_over_subscription_ratio    = 20.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] message_reap_interval          = 86400 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] message_ttl                    = 2592000 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] migration_create_volume_timeout_secs = 300 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] monkey_patch                   = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] monkey_patch_modules           = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] my_ip                          = 192.168.122.199 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] no_snapshot_gb_quota           = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] num_iser_scan_tries            = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] num_shell_tries                = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] num_volume_device_scan_tries   = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] nvmeof_conn_info_version       = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] nvmet_ns_id                    = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] nvmet_port_id                  = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_max_limit                = 1000 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_volume_ext_list          = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_volume_listen_port       = 8776 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_volume_use_ssl           = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] osapi_volume_workers           = 2 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] per_volume_size_limit          = -1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] periodic_fuzzy_delay           = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] periodic_interval              = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] public_endpoint                = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] publish_errors                 = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_backup_gigabytes         = 1000 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_backups                  = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_gigabytes                = 1000 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_groups                   = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_snapshots                = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] quota_volumes                  = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] rate_limit_burst               = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] rate_limit_except_level        = CRITICAL {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] rate_limit_interval            = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] reinit_driver_count            = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] replication_device             = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] report_discard_supported       = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] report_interval                = 120 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] reservation_clean_interval     = 86400 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] reservation_expire             = 86400 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] reserved_image_namespaces      = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] reserved_percentage            = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] rpc_response_timeout           = 120 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] run_external_periodic_tasks    = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] scst_target_driver             = iscsi {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] scst_target_iqn_name           = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_down_time              = 720 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] shell_completion               = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] snapshot_name_template         = snapshot-%s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] split_loggers                  = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] state_path                     = /opt/stack/data/cinder {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] storage_availability_zone      = nova {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] storage_protocol               = iSCSI {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] syslog_log_facility            = LOG_USER {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] target_helper                  = lioadm {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] target_ip_address              = 192.168.122.199 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] target_port                    = 3260 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] target_protocol                = iscsi {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] target_secondary_ip_addresses  = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] trace_flags                    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] transport_url                  = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] until_refresh                  = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_chap_auth                  = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_default_quota_class        = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_journal                    = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_json                       = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_multipath_for_image_xfer   = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_stderr                     = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] use_syslog                     = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] verify_glance_signatures       = enabled {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_api_class               = cinder.volume.api.API {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_backend_name            = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_clear                   = zero {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_clear_ionice            = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_clear_size              = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_copy_bps_limit          = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_dd_blocksize            = 1M {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_name_template           = volume-%s {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_service_inithost_offload = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volume_usage_audit_period      = month {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] zoning_mode                    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_concurrency.disable_process_locking = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.admin_password = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.admin_token = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.admin_user  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_port   = 35357 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_protocol = https {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_section = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_type   = password {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_uri    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.auth_version = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.cache       = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.certfile    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.identity_uri = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.include_service_catalog = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.insecure    = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.interface   = public {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.keyfile     = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_password =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcache_username =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.region_name = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.service_type = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.199/identity {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.backend                  = dogpile.cache.null {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.backend_argument         = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.backend_expiration_time  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.config_prefix            = cache.oslo {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.debug_cache_backend      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.enable_retry_client      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.enable_socket_keepalive  = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.enabled                  = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.enforce_fips_mode        = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.expiration_time          = 600 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.hashclient_retry_attempts = 2 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_dead_retry      = 300 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_pool_maxsize    = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_sasl_enabled    = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.password                 = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.proxies                  = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.redis_db                 = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91304]: INFO cinder.volume.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 15 04:13:23 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.remotefs [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91304) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.redis_server             = localhost:6379 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.retry_attempts           = 2 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.retry_delay              = 0.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.socket_keepalive_count   = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.socket_keepalive_idle    = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.socket_keepalive_interval = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.socket_timeout           = 1.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.tls_allowed_ciphers      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.tls_cafile               = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.tls_certfile             = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.tls_enabled              = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.tls_keyfile              = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cache.username                 = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.asyncio_connection    = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.asyncio_slave_connection = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.backend               = sqlalchemy {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.connection            = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.connection_debug      = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.connection_parameters =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.connection_recycle_time = 3600 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.connection_trace      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.db_inc_retry_interval = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.db_max_retries        = 20 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.db_max_retry_interval = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.db_retry_interval     = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.max_overflow          = 50 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.max_pool_size         = 5 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.max_retries           = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.mysql_wsrep_sync_wait = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.pool_timeout          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.retry_interval        = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.slave_connection      = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.sqlite_synchronous    = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.synchronous_reader    = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] database.use_db_reconnect      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.connection_string     = messaging:// {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.enabled               = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.es_doc_type           = notification {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.es_scroll_size        = 10000 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.es_scroll_time        = 2m {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.filter_error_trace    = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.hmac_keys             = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.sentinel_service_name = mymaster {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.socket_timeout        = 0.1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.trace_requests        = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler.trace_sqlalchemy      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler_jaeger.process_tags   = {} {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler_jaeger.service_name_prefix = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] profiler_otlp.service_name_prefix = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.enforce_new_defaults = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:23 devstack cinder-volume[91083]: WARNING oslo_config.cfg [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 15 04:13:23 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.enforce_scope      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.policy_default_rule = default {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.policy_file        = policy.yaml {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] coordination.backend_url       = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.group          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.helper_command = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] privsep_osbrick.user           = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.group         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.helper_command = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] cinder_sys_admin.user          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.auth_section      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.auth_type         = password {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.cafile            = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.certfile          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.collect_timing    = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.insecure          = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.keyfile           = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.send_service_user_token = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.split_loggers     = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] service_user.timeout           = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.auth_section            = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.auth_type               = password {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.certfile                = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.collect_timing          = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.insecure                = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.keyfile                 = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.region_name             = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.split_loggers           = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] glance.timeout                 = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.backend_availability_zone = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.chap_password = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.chap_username =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.disk_geometry = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.driver_client_cert = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.driver_client_cert_key = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.driver_data_namespace = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.driver_use_ssl = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.extra_capabilities = {} {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.filter_function = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.goodness_function = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.iscsi_target_flags =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.iscsi_write_cache = on {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.iser_helper   = tgtadm {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.iser_ip_address = 192.168.122.199 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.iser_port     = 3260 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_host      =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_login     = admin {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_mount_options = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_password  = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_private_key =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_share_path =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.num_shell_tries = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.quobyte_volume_url = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.replication_device = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.report_discard_supported = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.reserved_percentage = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.target_helper = tgtadm {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.target_ip_address = 192.168.122.199 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.target_port   = 3260 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.target_protocol = iscsi {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.trace_flags   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.unique_fqdn_network = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.use_chap_auth = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_backend_name = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_clear  = zero {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_clear_ionice = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_clear_size = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_reports.file_event_handler = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_reports.log_dir           = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.backend_availability_zone = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.backend_host         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.chap_password        = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.chap_username        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.chiscsi_conf         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.disk_geometry        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.driver_client_cert   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.driver_data_namespace = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.driver_use_ssl       = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.extra_capabilities   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.filter_function      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.goodness_function    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.iser_helper          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.iser_ip_address      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.iser_port            = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.iser_target_prefix   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_host             = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_login            = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_mount_options    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_password         = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_private_key      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_share_path       = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_ssh_port         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.num_shell_tries      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.nvmet_port_id        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.replication_device   = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.report_discard_supported = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.reserved_percentage  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.scst_target_driver   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.storage_protocol     = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.target_helper        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.target_ip_address    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.target_port          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.target_prefix        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.target_protocol      = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.trace_flags          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.use_chap_auth        = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_clear         = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_clear_size    = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] QuobyteHD.volumes_dir          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.ssl      = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_notifications.driver = [] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_notifications.retry = -1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] key_manager.fixed_key          = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.barbican_api_version  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.barbican_endpoint     = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.barbican_endpoint_type = public {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.barbican_region_name  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.cafile                = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.certfile              = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.collect_timing        = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.insecure              = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.keyfile               = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.number_of_retries     = 60 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.retry_delay           = 1 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.send_service_user_token = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.split_loggers         = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.timeout               = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.verify_ssl            = True {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican.verify_ssl_path       = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.auth_section = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.auth_type = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.cafile   = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.certfile = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.collect_timing = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.insecure = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.keyfile  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.split_loggers = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] barbican_service_user.timeout  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.approle_role_id          = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.approle_secret_id        = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.kv_mountpoint            = secret {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.kv_path                  = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.kv_version               = 2 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.namespace                = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.root_token_id            = **** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.ssl_ca_crt_file          = None {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.timeout                  = 60.0 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.use_ssl                  = False {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:24 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] ******************************************************************************** {{(pid=91083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91304) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 15 04:13:24 devstack cinder-volume[91304]: WARNING cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 15 04:13:24 devstack cinder-volume[91304]: WARNING cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Running cmd (subprocess): mount.quobyte {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:24 devstack quobyte-client[91305]: Reading configuration file: /etc/quobyte/client.cfg
Jun 15 04:13:24 devstack quobyte-client[91305]: Invalid parameters found, error: missing mount point.
Jun 15 04:13:24 devstack quobyte-client[91305]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 15 04:13:24 devstack quobyte-client[91305]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=91304) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:24 devstack cinder-volume[91304]: INFO cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac ...
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a -c /etc/quobyte/client-cinder.cfg {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:24 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a -c /etc/quobyte/client-cinder.cfg
Jun 15 04:13:24 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:24 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:24 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.749s {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:24 devstack cinder-volume[91304]: INFO cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac succeeded
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=91304) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.760s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:25 devstack sudo[91379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:25 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:25 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.599s {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:25 devstack cinder-volume[91304]: INFO cinder.volume.driver [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Driver hasn't implemented _init_vendor_properties()
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG cinder.volume.driver [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91304) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_db.sqlalchemy.engines [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG dbcounter [-] [91304] Writer thread running {{(pid=91304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG cinder.db.sqlalchemy.api [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Building query based on filter {{(pid=91304) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG cinder.image.image_utils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91304) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 15 04:13:25 devstack cinder-volume[91304]: INFO cinder.keymgr.migration [None req-3e0e316a-2a17-4bab-8637-f76c89a144cd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=91304) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=91304) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:25 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:25 devstack sudo[91382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:25 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:26 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.584s {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG cinder.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Notifying Schedulers of capabilities ... {{(pid=91304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:13:26 devstack cinder-volume[91304]: INFO cinder.volume.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Driver initialization completed successfully.
Jun 15 04:13:26 devstack cinder-volume[91304]: INFO cinder.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Initiating service 3 cleanup
Jun 15 04:13:26 devstack cinder-volume[91304]: INFO cinder.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Service 3 cleanup completed.
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG cinder.service [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Creating RPC server for service cinder-volume {{(pid=91304) start /opt/stack/cinder/cinder/service.py:231}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG cinder.service [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91304) start /opt/stack/cinder/cinder/service.py:237}}
Jun 15 04:13:26 devstack cinder-volume[91304]: INFO cinder.volume.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=91304) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=91304) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:26 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:26 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:26 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:27 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:27 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.612s {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:27 devstack cinder-volume[91304]: INFO cinder.volume.manager [None req-77c6d5d5-2ce4-4a6b-a9b6-ce090843f120 None None] Driver post RPC initialization completed successfully.
Jun 15 04:13:27 devstack cinder-volume[91304]: DEBUG oslo_service.periodic_task [None req-7d17e63b-3c98-4f82-9147-a81caba9494c None None] Running periodic task VolumeManager._thread_info {{(pid=91304) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:13:27 devstack cinder-volume[91304]: DEBUG cinder.volume.manager [None req-7d17e63b-3c98-4f82-9147-a81caba9494c None None] thread count: 6 {{(pid=91304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:13:27 devstack cinder-volume[91304]: DEBUG cinder.volume.manager [None req-7d17e63b-3c98-4f82-9147-a81caba9494c None None] thread info: [<_MainThread(MainThread, started 135834807070848)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135834701253184)>, <Thread(Thread-3 (stat_writer), started daemon 135834696630528)>, <Thread(Rabbit-heartbeat, started daemon 135834698673920)>, <Thread(Thread-5 (_runner), started daemon 135834696129152)>, <Thread(Thread-7 (_runner), started daemon 135834696264000)>] {{(pid=91304) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=91304) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG cinder.volume.drivers.quobyte [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=91304) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91304) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:31 devstack sudo[91574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:31 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:31 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG oslo_concurrency.processutils [None req-31418024-9f31-4f92-9269-1769f791a565 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.585s {{(pid=91304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:31 devstack cinder-volume[91304]: DEBUG cinder.manager [None req-31418024-9f31-4f92-9269-1769f791a565 None None] Notifying Schedulers of capabilities ... {{(pid=91304) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:13:33 devstack cinder-volume[91083]: DEBUG dbcounter [-] [91083] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:13:34 devstack cinder-volume[91083]: INFO oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Caught SIGTERM, stopping children
Jun 15 04:13:34 devstack cinder-volume[91083]: DEBUG oslo_concurrency.lockutils [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Acquiring lock "singleton_lock" {{(pid=91083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:13:34 devstack cinder-volume[91083]: DEBUG oslo_concurrency.lockutils [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Acquired lock "singleton_lock" {{(pid=91083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:13:34 devstack cinder-volume[91083]: DEBUG oslo_concurrency.lockutils [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Releasing lock "singleton_lock" {{(pid=91083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:13:34 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Stop services. {{(pid=91083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 15 04:13:34 devstack cinder-volume[91083]: DEBUG oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Killing children. {{(pid=91083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 15 04:13:34 devstack cinder-volume[91083]: INFO oslo_service.backend._eventlet.service [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Waiting on 1 children to exit
Jun 15 04:13:37 devstack cinder-volume[91304]: DEBUG dbcounter [-] [91304] Writing DB stats cinder:SELECT=2 {{(pid=91304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:13:37 devstack cinder-volume[91304]: DEBUG dbcounter [-] [91304] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:13:39 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Acquiring lock "singleton_lock" {{(pid=91304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:13:39 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Acquired lock "singleton_lock" {{(pid=91304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:13:39 devstack cinder-volume[91304]: DEBUG oslo_concurrency.lockutils [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Releasing lock "singleton_lock" {{(pid=91304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:13:39 devstack cinder-volume[91304]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jun 15 04:13:39 devstack cinder-volume[91304]: WARNING amqp [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 04:13:39 devstack cinder-volume[91304]: WARNING amqp [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Received method (50, 41) during closing channel 1. This method will be ignored
Jun 15 04:13:39 devstack cinder-volume[91304]: WARNING amqp [None req-a43844fd-661b-477e-8ca5-067839551258 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 04:13:42 devstack cinder-volume[91798]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 04:13:42 devstack cinder-volume[91798]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 04:13:42 devstack cinder-volume[91798]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 04:13:43 devstack cinder-volume[91798]: INFO dbcounter [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Registered counter for database cinder
Jun 15 04:13:43 devstack cinder-volume[91798]: DEBUG oslo_db.sqlalchemy.engines [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:43 devstack cinder-volume[91798]: DEBUG dbcounter [-] [91798] Writer thread running {{(pid=91798) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 04:13:43 devstack cinder-volume[91798]: INFO cinder.rpc [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 15 04:13:43 devstack cinder-volume[91798]: INFO cinder.rpc [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 15 04:13:43 devstack cinder-volume[91798]: DEBUG oslo_db.sqlalchemy.engines [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:44 devstack cinder-volume[91798]: INFO cinder.volume.manager [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Determined volume DB was empty at startup.
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG cinder.volume.manager [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91798) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 15 04:13:44 devstack cinder-volume[91798]: WARNING stevedore.named [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 04:13:44 devstack cinder-volume[91798]: WARNING castellan.key_manager [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:13:44 devstack cinder-volume[91798]: WARNING cinder.keymgr.conf_key_mgr [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 04:13:44 devstack cinder-volume[91798]: INFO cinder.volume.manager [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_db.sqlalchemy.engines [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:44 devstack cinder-volume[91798]: INFO oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Starting 1 workers
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Started child 92103 {{(pid=91798) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Full set of CONF: {{(pid=91798) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] ******************************************************************************** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Configuration options gathered from: {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] ================================================================================ {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] allow_availability_zone_fallback = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] allow_compression_on_image_upload = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] allowed_direct_url_schemes     = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] api_rate_limit                 = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] auth_strategy                  = keystone {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_availability_zone      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_host                   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_name                   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_stats_polling_interval = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backup_api_class               = cinder.backup.api.API {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backup_name_template           = backup-%s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backup_use_same_host           = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backup_use_temp_snapshot       = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] chap_password                  = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] chap_username                  =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_internal_tenant_project_id = ca925d1a1aa2453bbcb42accaf2b1b33 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_internal_tenant_user_id = fa70387b81fc4027b4cad8319d0151e3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[92103]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cluster                        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] compression_format             = gzip {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] compute_api_class              = cinder.compute.nova.API {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] config_dir                     = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] config_source                  = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] control_exchange               = openstack {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] debug                          = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] default_availability_zone      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] default_group_type             = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] default_volume_type            = QuobyteHD {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] disk_geometry                  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] driver_client_cert             = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] driver_client_cert_key         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] driver_data_namespace          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] driver_ssl_cert_path           = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] driver_ssl_cert_verify         = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] driver_use_ssl                 = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] enable_new_services            = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] enable_unsupported_driver      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] enabled_backends               = ['QuobyteHD'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] enforce_multipath_for_image_xfer = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] filter_function                = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_api_insecure            = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_api_servers             = ['http://192.168.122.199/image'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_api_ssl_compression     = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_ca_certificates_file    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_catalog_info            = image:glance:publicURL {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_certfile                = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_keyfile                 = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_num_retries             = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance_request_timeout         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] goodness_function              = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] graceful_shutdown_timeout      = 5 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] group_api_class                = cinder.group.api.API {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] host                           = devstack {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_compress_on_upload       = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_conversion_address_space_limit = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_conversion_cpu_limit     = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_conversion_disable       = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_upload_use_cinder_backend = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_upload_use_internal_tenant = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_volume_cache_enabled     = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_volume_cache_max_count   = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] image_volume_cache_max_size_gb = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] init_host_max_objects_retrieval = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] instance_format                = [instance: %(uuid)s]  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] iscsi_target_flags             =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] iscsi_write_cache              = on {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] iser_helper                    = tgtadm {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] iser_ip_address                = 192.168.122.199 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] iser_port                      = 3260 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_color                      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_config_append              = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_dir                        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_file                       = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_options                    = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_rotate_interval            = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_rotate_interval_type       = days {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] log_rotation_type              = none {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] max_age                        = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] max_logfile_count              = 30 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] max_logfile_size_mb            = 200 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] max_over_subscription_ratio    = 20.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] message_reap_interval          = 86400 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] message_ttl                    = 2592000 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] migration_create_volume_timeout_secs = 300 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] monkey_patch                   = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] monkey_patch_modules           = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] my_ip                          = 192.168.122.199 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] no_snapshot_gb_quota           = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] num_iser_scan_tries            = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] num_shell_tries                = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] num_volume_device_scan_tries   = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] nvmeof_conn_info_version       = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] nvmet_ns_id                    = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] nvmet_port_id                  = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_max_limit                = 1000 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_volume_ext_list          = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_volume_listen_port       = 8776 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_volume_use_ssl           = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] osapi_volume_workers           = 2 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] per_volume_size_limit          = -1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] periodic_fuzzy_delay           = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] periodic_interval              = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] public_endpoint                = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] publish_errors                 = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_backup_gigabytes         = 1000 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_backups                  = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_gigabytes                = 1000 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_groups                   = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_snapshots                = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] quota_volumes                  = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] rate_limit_burst               = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] rate_limit_except_level        = CRITICAL {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] rate_limit_interval            = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] reinit_driver_count            = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] replication_device             = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] report_discard_supported       = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] report_interval                = 120 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] reservation_clean_interval     = 86400 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] reservation_expire             = 86400 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] reserved_image_namespaces      = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] reserved_percentage            = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] rpc_response_timeout           = 120 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] run_external_periodic_tasks    = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] scst_target_driver             = iscsi {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] scst_target_iqn_name           = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_down_time              = 720 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] shell_completion               = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] snapshot_name_template         = snapshot-%s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] split_loggers                  = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] state_path                     = /opt/stack/data/cinder {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] storage_availability_zone      = nova {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] storage_protocol               = iSCSI {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] syslog_log_facility            = LOG_USER {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] target_helper                  = lioadm {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] target_ip_address              = 192.168.122.199 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] target_port                    = 3260 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] target_protocol                = iscsi {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] target_secondary_ip_addresses  = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] trace_flags                    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] transport_url                  = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] until_refresh                  = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_chap_auth                  = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_default_quota_class        = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_journal                    = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_json                       = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_multipath_for_image_xfer   = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_stderr                     = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] use_syslog                     = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] verify_glance_signatures       = enabled {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_api_class               = cinder.volume.api.API {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92103) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_backend_name            = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_clear                   = zero {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_clear_ionice            = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_clear_size              = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_copy_bps_limit          = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_dd_blocksize            = 1M {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_name_template           = volume-%s {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_service_inithost_offload = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volume_usage_audit_period      = month {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] zoning_mode                    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_concurrency.disable_process_locking = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.admin_password = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.admin_token = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.admin_user  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_port   = 35357 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_protocol = https {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_section = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_type   = password {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_uri    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.auth_version = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.cache       = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.certfile    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.identity_uri = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.include_service_catalog = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.insecure    = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.interface   = public {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.keyfile     = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_password =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcache_username =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.region_name = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.service_type = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.199/identity {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.backend                  = dogpile.cache.null {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.backend_argument         = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.backend_expiration_time  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.config_prefix            = cache.oslo {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.debug_cache_backend      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.enable_retry_client      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.enable_socket_keepalive  = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.enabled                  = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.enforce_fips_mode        = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.expiration_time          = 600 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.hashclient_retry_attempts = 2 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_dead_retry      = 300 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_pool_maxsize    = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_sasl_enabled    = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.password                 = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.proxies                  = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.redis_db                 = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.redis_server             = localhost:6379 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.retry_attempts           = 2 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.retry_delay              = 0.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.socket_keepalive_count   = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.socket_keepalive_idle    = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.socket_keepalive_interval = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.socket_timeout           = 1.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.tls_allowed_ciphers      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.tls_cafile               = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.tls_certfile             = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.tls_enabled              = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.tls_keyfile              = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cache.username                 = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.asyncio_connection    = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.asyncio_slave_connection = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.backend               = sqlalchemy {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.connection            = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.connection_debug      = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.connection_parameters =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.connection_recycle_time = 3600 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.connection_trace      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.db_inc_retry_interval = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.db_max_retries        = 20 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.db_max_retry_interval = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.db_retry_interval     = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.max_overflow          = 50 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.max_pool_size         = 5 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.max_retries           = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.mysql_wsrep_sync_wait = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.pool_timeout          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.retry_interval        = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.slave_connection      = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.sqlite_synchronous    = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.synchronous_reader    = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] database.use_db_reconnect      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.connection_string     = messaging:// {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.enabled               = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.es_doc_type           = notification {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.es_scroll_size        = 10000 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.es_scroll_time        = 2m {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.filter_error_trace    = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.hmac_keys             = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.sentinel_service_name = mymaster {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.socket_timeout        = 0.1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.trace_requests        = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler.trace_sqlalchemy      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler_jaeger.process_tags   = {} {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler_jaeger.service_name_prefix = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] profiler_otlp.service_name_prefix = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.enforce_new_defaults = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: WARNING oslo_config.cfg [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.enforce_scope      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.policy_default_rule = default {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.policy_file        = policy.yaml {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] coordination.backend_url       = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.group          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.helper_command = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] privsep_osbrick.user           = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.group         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.helper_command = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] cinder_sys_admin.user          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.auth_section      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.auth_type         = password {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.cafile            = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.certfile          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.collect_timing    = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.insecure          = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.keyfile           = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.send_service_user_token = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.split_loggers     = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] service_user.timeout           = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.auth_section            = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.auth_type               = password {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.certfile                = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.collect_timing          = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.insecure                = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.keyfile                 = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.region_name             = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.split_loggers           = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] glance.timeout                 = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.backend_availability_zone = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.chap_password = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.chap_username =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.disk_geometry = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.driver_client_cert = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.driver_client_cert_key = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.driver_data_namespace = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.driver_use_ssl = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.extra_capabilities = {} {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.filter_function = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.goodness_function = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.iscsi_target_flags =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.iscsi_write_cache = on {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.iser_helper   = tgtadm {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.iser_ip_address = 192.168.122.199 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.iser_port     = 3260 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_host      =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_login     = admin {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_mount_options = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_password  = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_private_key =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_share_path =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.num_shell_tries = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92103) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.quobyte_volume_url = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.replication_device = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.report_discard_supported = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.reserved_percentage = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.target_helper = tgtadm {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.target_ip_address = 192.168.122.199 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.target_port   = 3260 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.target_protocol = iscsi {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.trace_flags   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.unique_fqdn_network = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.use_chap_auth = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_backend_name = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_clear  = zero {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_clear_ionice = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_clear_size = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Running cmd (subprocess): mount.quobyte {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_reports.file_event_handler = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_reports.log_dir           = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.backend_availability_zone = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.backend_host         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.chap_password        = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.chap_username        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.chiscsi_conf         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.disk_geometry        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.driver_client_cert   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.driver_data_namespace = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.driver_use_ssl       = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.extra_capabilities   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.filter_function      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.goodness_function    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.iser_helper          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.iser_ip_address      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.iser_port            = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.iser_target_prefix   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_host             = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_login            = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_mount_options    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_password         = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_private_key      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_share_path       = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_ssh_port         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.num_shell_tries      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.nvmet_port_id        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.replication_device   = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.report_discard_supported = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.reserved_percentage  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.scst_target_driver   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.storage_protocol     = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.target_helper        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.target_ip_address    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.target_port          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.target_prefix        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.target_protocol      = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.trace_flags          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.use_chap_auth        = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_clear         = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_clear_size    = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] QuobyteHD.volumes_dir          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.ssl      = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_notifications.driver = [] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_notifications.retry = -1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] key_manager.fixed_key          = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.barbican_api_version  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.barbican_endpoint     = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.barbican_endpoint_type = public {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.barbican_region_name  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.cafile                = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.certfile              = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.collect_timing        = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.insecure              = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.keyfile               = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.number_of_retries     = 60 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.retry_delay           = 1 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.send_service_user_token = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.split_loggers         = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.timeout               = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.verify_ssl            = True {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican.verify_ssl_path       = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.auth_section = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.auth_type = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.cafile   = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.certfile = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.collect_timing = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.insecure = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.keyfile  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.split_loggers = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] barbican_service_user.timeout  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.approle_role_id          = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.approle_secret_id        = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.kv_mountpoint            = secret {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.kv_path                  = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.kv_version               = 2 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.namespace                = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.root_token_id            = **** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.ssl_ca_crt_file          = None {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.timeout                  = 60.0 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.use_ssl                  = False {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 04:13:44 devstack cinder-volume[91798]: DEBUG oslo_service.backend._eventlet.service [None req-696c9d7a-2e3e-4e42-9324-f5a6d2d3e328 None None] ******************************************************************************** {{(pid=91798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 15 04:13:44 devstack quobyte-client[92104]: Reading configuration file: /etc/quobyte/client.cfg
Jun 15 04:13:44 devstack quobyte-client[92104]: Invalid parameters found, error: missing mount point.
Jun 15 04:13:44 devstack quobyte-client[92104]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 15 04:13:44 devstack quobyte-client[92104]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:44 devstack sudo[92105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:44 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:44 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.581s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:44 devstack cinder-volume[92103]: INFO cinder.volume.driver [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Driver hasn't implemented _init_vendor_properties()
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG cinder.volume.driver [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92103) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG oslo_db.sqlalchemy.engines [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writer thread running {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 04:13:44 devstack cinder-volume[92103]: DEBUG cinder.db.sqlalchemy.api [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Building query based on filter {{(pid=92103) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92103) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:45 devstack cinder-volume[92103]: INFO cinder.keymgr.migration [None req-74f89e44-f83b-41aa-ab29-038350740744 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 15 04:13:45 devstack sudo[92136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:45 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:45 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.588s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:13:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Driver initialization completed successfully.
Jun 15 04:13:45 devstack cinder-volume[92103]: INFO cinder.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Initiating service 3 cleanup
Jun 15 04:13:45 devstack cinder-volume[92103]: INFO cinder.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Service 3 cleanup completed.
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.service [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Creating RPC server for service cinder-volume {{(pid=92103) start /opt/stack/cinder/cinder/service.py:231}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.service [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92103) start /opt/stack/cinder/cinder/service.py:237}}
Jun 15 04:13:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:13:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:13:45 devstack sudo[92142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:13:45 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:13:46 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root
Jun 15 04:13:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.576s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:13:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-64d00a62-6105-48b8-ac5e-464f60a5e9c9 None None] Driver post RPC initialization completed successfully.
Jun 15 04:13:54 devstack cinder-volume[91798]: DEBUG dbcounter [-] [91798] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91798) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:13:55 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:13:56 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=3 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:14:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:14:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 6 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:14:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Flow 'volume_create_manager' (535fa9e4-154d-4027-a602-e16e26c95e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9432a167-61bf-4207-95fb-14a66aec92b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9432a167-61bf-4207-95fb-14a66aec92b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1617298019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746e6721-f78d-4b33-a2eb-3c6a28365ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758bae94979049c3b73a36def8932152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:14:43Z,use_quota=True,user_id='b61ec06f69de44d78a56d8f8b540bab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf6deaf-93a4-40e6-b93e-13ebb38e2884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf6deaf-93a4-40e6-b93e-13ebb38e2884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0c1b1c-cb7f-47e8-b6cf-aab21948ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0c1b1c-cb7f-47e8-b6cf-aab21948ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746e6721-f78d-4b33-a2eb-3c6a28365ca3', 'volume_name': 'volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fd1a2-6fb7-4c2d-99cf-2b25a4f4b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fd1a2-6fb7-4c2d-99cf-2b25a4f4b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02f9df5-f337-46ab-9dca-4cfd8681f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:14:43 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Volume 746e6721-f78d-4b33-a2eb-3c6a28365ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3', 'volume_size': 1}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1617298019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746e6721-f78d-4b33-a2eb-3c6a28365ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758bae94979049c3b73a36def8932152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:14:43Z,use_quota=True,user_id='b61ec06f69de44d78a56d8f8b540bab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Creating volume 746e6721-f78d-4b33-a2eb-3c6a28365ca3 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:14:43 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:14:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:14:43 devstack sudo[92235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 1073741824
Jun 15 04:14:43 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:14:44 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root
Jun 15 04:14:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 1073741824" returned: 0 in 1.033s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:14:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:14:44 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3
Jun 15 04:14:44 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:14:45 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3" returned: 0 in 0.852s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02f9df5-f337-46ab-9dca-4cfd8681f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6da34d3-a453-4a29-8489-41401e048b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:14:45 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Volume volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 (746e6721-f78d-4b33-a2eb-3c6a28365ca3): created successfully
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6da34d3-a453-4a29-8489-41401e048b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:14:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Flow 'volume_create_manager' (535fa9e4-154d-4027-a602-e16e26c95e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:14:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-72e72ffc-2f91-4f86-b2f0-537f29d6949c tempest-TaggedAttachmentsTest-90829218 None] Created volume successfully.
Jun 15 04:14:55 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:14:55 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Flow 'volume_create_manager' (0badbbbb-d18b-41b7-a986-f464eb887a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c4727-9e80-4412-afca-8b6024962559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c4727-9e80-4412-afca-8b6024962559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1559354164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07343b14-5e9e-4721-a17e-f4fa09768810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710954a893aa403589df419358d1f785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:15:19Z,use_quota=True,user_id='895c8793e56d47bd846e4c3c1bfbc913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8e3af4-8a56-418c-aac1-ddb05c55ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8e3af4-8a56-418c-aac1-ddb05c55ab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df3f3b4-4574-465e-8299-1d8fdee8a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df3f3b4-4574-465e-8299-1d8fdee8a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07343b14-5e9e-4721-a17e-f4fa09768810', 'volume_name': 'volume-07343b14-5e9e-4721-a17e-f4fa09768810', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286bdc7-894b-4141-92e6-398f87a446e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286bdc7-894b-4141-92e6-398f87a446e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146831ac-5ff0-4443-801c-86c4c0d19778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:19 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Volume 07343b14-5e9e-4721-a17e-f4fa09768810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07343b14-5e9e-4721-a17e-f4fa09768810', 'volume_size': 1}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1559354164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07343b14-5e9e-4721-a17e-f4fa09768810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710954a893aa403589df419358d1f785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:15:19Z,use_quota=True,user_id='895c8793e56d47bd846e4c3c1bfbc913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Creating volume 07343b14-5e9e-4721-a17e-f4fa09768810 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:15:19 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:15:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:19 devstack sudo[92917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810 1073741824
Jun 15 04:15:19 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:21 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810 1073741824" returned: 0 in 1.653s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:21 devstack sudo[92944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810
Jun 15 04:15:21 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:22 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810" returned: 0 in 1.380s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] <== create_volume: return (3135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.138s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146831ac-5ff0-4443-801c-86c4c0d19778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07343b14-5e9e-4721-a17e-f4fa09768810', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a3ba0d-ad7f-4bd2-a275-3cec2a218b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:22 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Volume volume-07343b14-5e9e-4721-a17e-f4fa09768810 (07343b14-5e9e-4721-a17e-f4fa09768810): created successfully
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a3ba0d-ad7f-4bd2-a275-3cec2a218b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Flow 'volume_create_manager' (0badbbbb-d18b-41b7-a986-f464eb887a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:15:22 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e63433ec-b6ba-4b41-a09a-2c5c7010ae20 tempest-VolumesAdminNegativeTest-806542714 None] Created volume successfully.
Jun 15 04:15:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Acquiring lock "cinder-07343b14-5e9e-4721-a17e-f4fa09768810-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:15:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Lock "cinder-07343b14-5e9e-4721-a17e-f4fa09768810-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:15:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Acquiring lock "cinder-quobyte-07343b14-5e9e-4721-a17e-f4fa09768810" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:15:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Lock "cinder-quobyte-07343b14-5e9e-4721-a17e-f4fa09768810" acquired by "delete_volume" :: waited 0.035s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:15:25 devstack cinder-volume[92103]: INFO oslo.privsep.daemon [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj45gwr7t/privsep.sock']
Jun 15 04:15:25 devstack sudo[92957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj45gwr7t/privsep.sock
Jun 15 04:15:25 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:28 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:28 devstack cinder-volume[92103]: INFO oslo.privsep.daemon [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Spawned new privsep daemon via rootwrap
Jun 15 04:15:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Accepted privsep connection to /tmp/tmpj45gwr7t/privsep.sock {{(pid=92103) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Jun 15 04:15:28 devstack cinder-volume[92103]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 15 04:15:28 devstack cinder-volume[92103]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 15 04:15:28 devstack cinder-volume[92103]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 15 04:15:28 devstack cinder-volume[92103]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92968
Jun 15 04:15:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c88003-efbe-45b8-875f-6c3bbb755ca3]: (2,) {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:15:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1650a9b7-c6f0-426a-9bc9-32d5d23b126f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:15:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:28 devstack sudo[92970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810
Jun 15 04:15:28 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:29 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810" returned: 0 in 1.226s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:29 devstack sudo[93011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810
Jun 15 04:15:29 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:30 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-07343b14-5e9e-4721-a17e-f4fa09768810" returned: 0 in 0.927s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Lock "cinder-quobyte-07343b14-5e9e-4721-a17e-f4fa09768810" released by "delete_volume" :: held 5.585s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:15:30 devstack cinder-volume[92103]: WARNING cinder.quota [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:15:30 devstack cinder-volume[92103]: WARNING cinder.quota [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:15:30 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Created reservations ['f67c9481-7dab-4520-b0f2-07937b5fd0a1', '2b94d0d3-e090-4a95-8512-01ef174273f6', '4cdf036d-8897-4343-a9e7-eeee158777c2', '5d660637-5452-4324-9bd7-d052ac847ca9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:15:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:15:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:15:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:31 devstack sudo[93037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:15:31 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:31 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.718s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:31 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:15:31 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Deleted volume successfully.
Jun 15 04:15:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-39b458e9-1304-4312-bc1f-a56ca27a365b tempest-VolumesAdminNegativeTest-806542714 None] Lock "cinder-07343b14-5e9e-4721-a17e-f4fa09768810-delete_volume" released by "delete_volume" :: held 6.698s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Flow 'volume_create_manager' (0a6dfb39-c945-4d7c-b719-c477c6a19f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391142a3-840f-41d1-9e94-cae05252debf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391142a3-840f-41d1-9e94-cae05252debf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1307236019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec1a6ee-4d17-4054-98eb-9b0da935b8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1632285ef64e6eaf807fe0ddd2c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:15:35Z,use_quota=True,user_id='9eb3b80bfd0a4817839ce7f4fea1c4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39970ada-4c03-4408-98e3-fbbf62356a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39970ada-4c03-4408-98e3-fbbf62356a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8255bd-9dc5-4ce9-8861-91339fa3461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8255bd-9dc5-4ce9-8861-91339fa3461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec1a6ee-4d17-4054-98eb-9b0da935b8dc', 'volume_name': 'volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a9c26f-c132-4384-9119-be8c22a9ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a9c26f-c132-4384-9119-be8c22a9ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebd08f0-72bc-443c-83e3-b69e7e77bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:35 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Volume fec1a6ee-4d17-4054-98eb-9b0da935b8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc', 'volume_size': 1}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1307236019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec1a6ee-4d17-4054-98eb-9b0da935b8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1632285ef64e6eaf807fe0ddd2c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:15:35Z,use_quota=True,user_id='9eb3b80bfd0a4817839ce7f4fea1c4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Creating volume fec1a6ee-4d17-4054-98eb-9b0da935b8dc {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:15:35 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:35 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc 1073741824
Jun 15 04:15:35 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:35 devstack sudo[93114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:15:35 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:36 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.055s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 8 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:15:36 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc 1073741824" returned: 0 in 1.304s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:36 devstack sudo[93131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc
Jun 15 04:15:36 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:37 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" returned: 0 in 0.599s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebd08f0-72bc-443c-83e3-b69e7e77bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a912a4a9-ca18-4edc-b917-1dd54fd417aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Volume volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc (fec1a6ee-4d17-4054-98eb-9b0da935b8dc): created successfully
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a912a4a9-ca18-4edc-b917-1dd54fd417aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Flow 'volume_create_manager' (0a6dfb39-c945-4d7c-b719-c477c6a19f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:15:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d10dc94a-2d05-4950-88fb-82d807418347 tempest-AttachVolumeTestJSON-362422834 None] Created volume successfully.
Jun 15 04:15:45 devstack cinder-volume[92103]: WARNING py.warnings [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jun 15 04:15:45 devstack cinder-volume[92103]:   .first()
Jun 15 04:15:45 devstack cinder-volume[92103]: 
Jun 15 04:15:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e64e12a-3517-4116-a8a2-eec783852e0a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:15:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:45 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc
Jun 15 04:15:45 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:46 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" returned: 0 in 1.085s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.116s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5837af22-4598-4596-8680-d707ef959dd0', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:15:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-f9069bd7-da31-4d80-89e2-a41e58346167 req-413dcb62-f0fc-4c75-98c8-eb95150e567d tempest-AttachVolumeTestJSON-362422834 None] attachment_update completed successfully.
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Flow 'volume_create_manager' (259be94b-5696-4ac4-8fa3-a3e5c7390b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f10cc0-b52f-4f2c-ad7a-0ec88bb84220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f10cc0-b52f-4f2c-ad7a-0ec88bb84220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-158011007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ba4851-13f8-4e31-b3cc-8c3f2e2433d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b01fdd1ac3a4e67bea0196c56d822c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:15:47Z,use_quota=True,user_id='b2dafe24aed04115b95875d51a8cef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bd8747-5fe1-47b7-a1ce-ffb9d986a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bd8747-5fe1-47b7-a1ce-ffb9d986a065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e584779-7d28-489c-8a74-2d36c6fdc4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e584779-7d28-489c-8a74-2d36c6fdc4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ba4851-13f8-4e31-b3cc-8c3f2e2433d1', 'volume_name': 'volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbbe64e-c0e5-4a66-b384-8bfe68c4dd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbbe64e-c0e5-4a66-b384-8bfe68c4dd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865ee89f-ef03-4dbb-8a14-d0cd6e7c5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:47 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Volume 49ba4851-13f8-4e31-b3cc-8c3f2e2433d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1', 'volume_size': 1}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-158011007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ba4851-13f8-4e31-b3cc-8c3f2e2433d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b01fdd1ac3a4e67bea0196c56d822c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:15:47Z,use_quota=True,user_id='b2dafe24aed04115b95875d51a8cef36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Creating volume 49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:15:47 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:15:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:47 devstack sudo[93250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 1073741824
Jun 15 04:15:47 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:48 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 1073741824" returned: 0 in 1.294s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:48 devstack sudo[93642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1
Jun 15 04:15:48 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:49 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" returned: 0 in 0.766s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865ee89f-ef03-4dbb-8a14-d0cd6e7c5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6d3b6d-bae6-4855-8f80-ae3661b73575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:15:49 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Volume volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 (49ba4851-13f8-4e31-b3cc-8c3f2e2433d1): created successfully
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6d3b6d-bae6-4855-8f80-ae3661b73575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:15:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Flow 'volume_create_manager' (259be94b-5696-4ac4-8fa3-a3e5c7390b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:15:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0b435a9e-fe51-4467-a247-0140a4b29d83 tempest-DeleteServersTestJSON-1460995620 None] Created volume successfully.
Jun 15 04:15:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:15:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:15:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ba24d-b40a-4e7c-ab7d-5b46145a4737]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:15:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:15:54 devstack sudo[93671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1
Jun 15 04:15:54 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:15:55 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root
Jun 15 04:15:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" returned: 0 in 1.475s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:15:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.493s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:15:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21f4dc6a-537f-4cee-b1d0-7a085ef4eb59', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:15:55 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-4ff94bb1-4920-4251-9ca4-86c8bd8f0a22 req-7a02c190-319f-46d2-8fe6-de7d210eeb0a tempest-DeleteServersTestJSON-1460995620 None] attachment_update completed successfully.
Jun 15 04:16:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:01 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1788c3-0e13-4aba-9fe2-a791486db64d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cd1f4d4f-5df3-4178-a509-e5c6af069120 tempest-GroupSnapshotsV319Test-11856162 None] Group tempest-GroupSnapshotsV319Test-Group-1513866176: creating
Jun 15 04:16:01 devstack sudo[93788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3
Jun 15 04:16:01 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cd1f4d4f-5df3-4178-a509-e5c6af069120 tempest-GroupSnapshotsV319Test-11856162 None] Group tempest-GroupSnapshotsV319Test-Group-1513866176: created successfully
Jun 15 04:16:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cd1f4d4f-5df3-4178-a509-e5c6af069120 tempest-GroupSnapshotsV319Test-11856162 None] Create group completed successfully.
Jun 15 04:16:02 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3" returned: 0 in 0.954s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.972s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa2af3c8-1760-49dd-8ca1-fa69b7b3ab58', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:16:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-8da634da-52d0-402c-b024-9bea7fefeeda req-32d8ea49-405d-48bb-9d2f-16e30d9d28d2 tempest-TaggedAttachmentsTest-90829218 None] attachment_update completed successfully.
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Flow 'volume_create_manager' (1b24b46b-d7fd-4e2e-a268-7144a48b64e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011d966d-3bd8-489f-bb36-ef0f49331a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011d966d-3bd8-489f-bb36-ef0f49331a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854838701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc42e7fb-54c9-4f41-a380-fc4632c7f2df,host='devstack@QuobyteHD#QuobyteHD',id=4a4161c0-2f88-48ca-9645-11c68ef08f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='987ca89cd5724d32b97721ec9ef95473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:16:03Z,use_quota=True,user_id='3e90b50c46fb4d5584a47448f524fa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb6213b-ad7a-4efa-951b-15f01b519f4b),volume_type_id=0eb6213b-ad7a-4efa-951b-15f01b519f4b)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a0f24-b159-4df5-a09d-b405d88116bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a0f24-b159-4df5-a09d-b405d88116bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4045d4-e373-46c6-8ff6-dc7fe95f1fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4045d4-e373-46c6-8ff6-dc7fe95f1fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4161c0-2f88-48ca-9645-11c68ef08f61', 'volume_name': 'volume-4a4161c0-2f88-48ca-9645-11c68ef08f61', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7340e8e8-731c-4bd6-a1ea-3880c0dc5a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7340e8e8-731c-4bd6-a1ea-3880c0dc5a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f178af-db6e-4b57-bcac-576e051960c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Volume 4a4161c0-2f88-48ca-9645-11c68ef08f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4161c0-2f88-48ca-9645-11c68ef08f61', 'volume_size': 1}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cc42e7fb-54c9-4f41-a380-fc4632c7f2df,created_at=2026-06-15T02:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854838701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc42e7fb-54c9-4f41-a380-fc4632c7f2df,host='devstack@QuobyteHD#QuobyteHD',id=4a4161c0-2f88-48ca-9645-11c68ef08f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='987ca89cd5724d32b97721ec9ef95473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:16:03Z,use_quota=True,user_id='3e90b50c46fb4d5584a47448f524fa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb6213b-ad7a-4efa-951b-15f01b519f4b),volume_type_id=0eb6213b-ad7a-4efa-951b-15f01b519f4b)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Creating volume 4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:16:03 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:03 devstack sudo[93968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 1073741824
Jun 15 04:16:03 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:03 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-8da634da-52d0-402c-b024-9bea7fefeeda req-787e795c-13d3-4886-b604-bd97659540ef tempest-TaggedAttachmentsTest-90829218 None] Terminate volume connection completed successfully.
Jun 15 04:16:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-8da634da-52d0-402c-b024-9bea7fefeeda req-787e795c-13d3-4886-b604-bd97659540ef tempest-TaggedAttachmentsTest-90829218 None] Deleting attachment aa2af3c8-1760-49dd-8ca1-fa69b7b3ab58. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:16:04 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 1073741824" returned: 0 in 0.917s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:04 devstack sudo[94042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61
Jun 15 04:16:04 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:04 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61" returned: 0 in 0.629s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f178af-db6e-4b57-bcac-576e051960c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4161c0-2f88-48ca-9645-11c68ef08f61', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35625f23-6d6e-48a9-9ed4-71a11f824635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Volume volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 (4a4161c0-2f88-48ca-9645-11c68ef08f61): created successfully
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35625f23-6d6e-48a9-9ed4-71a11f824635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Flow 'volume_create_manager' (1b24b46b-d7fd-4e2e-a268-7144a48b64e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:16:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-85afe75d-3844-474d-b2be-24c428abe8b3 tempest-GroupSnapshotsV319Test-11856162 None] Created volume successfully.
Jun 15 04:16:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-5fc7f62c-2658-4a22-8ec0-cccd3086c30f req-e517509f-a46b-4181-a5e8-08f16add7815 tempest-DeleteServersTestJSON-1460995620 None] Terminate volume connection completed successfully.
Jun 15 04:16:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-5fc7f62c-2658-4a22-8ec0-cccd3086c30f req-e517509f-a46b-4181-a5e8-08f16add7815 tempest-DeleteServersTestJSON-1460995620 None] Deleting attachment 21f4dc6a-537f-4cee-b1d0-7a085ef4eb59. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:16:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] GroupSnapshot 4beecca4-39ce-49b4-93af-d31af879344b: creating.
Jun 15 04:16:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Group snapshot 4beecca4-39ce-49b4-93af-d31af879344b: creating. {{(pid=92103) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 04:16:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Creating offline snapshot fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf of volume 4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:16:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d3b34-d686-4e09-bb58-7e24a9ad26c6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:05 devstack sudo[94052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61
Jun 15 04:16:05 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:06 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61" returned: 0 in 0.784s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:06 devstack sudo[94066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf 1G
Jun 15 04:16:06 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:07 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf 1G" returned: 0 in 1.213s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:07 devstack sudo[94447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf
Jun 15 04:16:07 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:08 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" returned: 0 in 0.772s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:08 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:08 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf
Jun 15 04:16:08 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Acquiring lock "cinder-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Lock "cinder-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Acquiring lock "cinder-quobyte-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Lock "cinder-quobyte-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfd7c07-bb4a-4009-be86-568dceb73f09]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:08 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1
Jun 15 04:16:08 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:09 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" returned: 0 in 0.689s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:09 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info
Jun 15 04:16:09 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:09 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" returned: 0 in 0.896s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:09 devstack sudo[94467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1
Jun 15 04:16:09 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:10 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info" returned: 0 in 0.799s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:10 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:10 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info
Jun 15 04:16:10 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:10 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" returned: 0 in 0.702s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Lock "cinder-quobyte-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1" released by "delete_volume" :: held 1.671s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Created reservations ['f3f0705c-19b1-4e3f-a822-f0df20dd4f6f', '2c40d51f-0f7c-4116-b899-23548482e737', 'ecfe0702-6b27-4b38-aa19-8c08837f37f4', 'c59f1663-d2c8-4be2-98dd-414ddd411979'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:10 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:16:10 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:10 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.info" returned: 0 in 0.724s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.098s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:10 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-2eb1e4e0-e9c0-46f1-b5d2-0f02959e659e tempest-GroupSnapshotsV319Test-11856162 None] group_snapshot 4beecca4-39ce-49b4-93af-d31af879344b: created successfully
Jun 15 04:16:11 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.711s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:16:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Deleted volume successfully.
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cae44097-9e23-4602-bdf9-afcba946541f tempest-DeleteServersTestJSON-1460995620 None] Lock "cinder-49ba4851-13f8-4e31-b3cc-8c3f2e2433d1-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] group_snapshot 4beecca4-39ce-49b4-93af-d31af879344b: deleting
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] group_snapshot 4beecca4-39ce-49b4-93af-d31af879344b: deleting {{(pid=92103) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "cinder-quobyte-4a4161c0-2f88-48ca-9645-11c68ef08f61" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Lock "cinder-quobyte-4a4161c0-2f88-48ca-9645-11c68ef08f61" acquired by "delete_snapshot" :: waited 0.052s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "cinder-quobyte-fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Lock "cinder-quobyte-fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Deleting offline snapshot fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf of volume 4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] snapshot_file for this snap is: volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb06ced7-f942-4afa-9d33-b588a1fad017]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:12 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf
Jun 15 04:16:12 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:12 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" returned: 0 in 0.805s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4161c0-2f88-48ca-9645-11c68ef08f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4443365-cb1d-4319-8a82-c7d3d206f110]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:12 devstack sudo[94483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61
Jun 15 04:16:12 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:13 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61" returned: 0 in 0.780s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:13 devstack sudo[94488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf
Jun 15 04:16:13 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:14 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" returned: 0 in 0.884s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:14 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf
Jun 15 04:16:14 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:15 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61.fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" returned: 0 in 0.692s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Lock "cinder-quobyte-fa4e3d38-88c7-4e4b-ae25-dadc8a2b87cf" released by "_delete_snapshot" :: held 3.279s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Lock "cinder-quobyte-4a4161c0-2f88-48ca-9645-11c68ef08f61" released by "delete_snapshot" :: held 3.318s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:15 devstack cinder-volume[92103]: WARNING cinder.quota [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-230248440 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-230248440, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:16:15 devstack cinder-volume[92103]: WARNING cinder.quota [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-230248440 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-230248440, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:16:15 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] Created reservations ['f6ffbc5e-fc0d-4bd1-b88a-954e8dfd57ab', '3916da71-b75a-42dc-b6b0-e14a2457ef2a', 'a6961cac-ad58-44ea-8f22-5dc348888c70', 'd4fd771a-4792-442f-a70d-1bad680dacc0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:16:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4089e7cd-425a-4ae4-b70e-717b5299a4f6 tempest-GroupSnapshotsV319Test-11856162 None] group_snapshot 4beecca4-39ce-49b4-93af-d31af879344b: deleted successfully
Jun 15 04:16:16 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=54,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=3 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:16:16 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=50,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=7 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:16:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "cinder-quobyte-4a4161c0-2f88-48ca-9645-11c68ef08f61" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Lock "cinder-quobyte-4a4161c0-2f88-48ca-9645-11c68ef08f61" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2130912-1a16-4c6f-b9c3-4216d945baf1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:16 devstack sudo[94498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61
Jun 15 04:16:16 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:17 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:17 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61
Jun 15 04:16:17 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:18 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4a4161c0-2f88-48ca-9645-11c68ef08f61" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Lock "cinder-quobyte-4a4161c0-2f88-48ca-9645-11c68ef08f61" released by "delete_volume" :: held 1.672s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Created reservations ['4192eba8-350a-4b1f-8ae5-23a3e3f4975f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:16:18 devstack cinder-volume[92103]: WARNING cinder.quota [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-230248440 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-230248440, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Created reservations ['5d57b6de-d8ee-4ac9-8bfe-044b8eecb3d7', 'ccb0a384-730d-4ffe-9dd8-09e60d2fbd68', 'c68fc25a-6cb1-4c4b-9bae-10d1b81c64df', 'ceb41249-7686-4e52-b615-459467733fa4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:18 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:16:18 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:19 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.723s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:19 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:16:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ca44dbfd-2c06-4d8c-ac03-404e8c2e93b7 tempest-GroupSnapshotsV319Test-11856162 None] Delete group completed successfully.
Jun 15 04:16:28 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:16:28 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:INSERT=3 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:16:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-2c7ee93d-2c4e-4af0-9244-502c6c70b022 req-24f9b93a-a7bc-4870-b16c-2a020890efda tempest-AttachVolumeTestJSON-362422834 None] Terminate volume connection completed successfully.
Jun 15 04:16:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-2c7ee93d-2c4e-4af0-9244-502c6c70b022 req-24f9b93a-a7bc-4870-b16c-2a020890efda tempest-AttachVolumeTestJSON-362422834 None] Deleting attachment 5837af22-4598-4596-8680-d707ef959dd0. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:35 devstack sudo[94631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:16:35 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:36 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.766s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Flow 'volume_create_manager' (291615f5-d565-4c05-8dfa-d1145ce75c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76eaa1a-67fa-4496-b6bf-ca059b8b57a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76eaa1a-67fa-4496-b6bf-ca059b8b57a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2054848797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b8e79c-c6a0-4da2-bca4-7a7840274b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934442e8953c420cb4d3fad83af50ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:16:37Z,use_quota=True,user_id='55ebbeb033dd4639b095ae728a96d7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33daafa4-f277-400b-bd26-b0087d18f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33daafa4-f277-400b-bd26-b0087d18f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21e27c6-42c2-408d-888a-44d37a47ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21e27c6-42c2-408d-888a-44d37a47ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b8e79c-c6a0-4da2-bca4-7a7840274b58', 'volume_name': 'volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434745bb-a357-45b4-a823-3d56a25ca43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434745bb-a357-45b4-a823-3d56a25ca43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76491c34-ab47-429f-b3d2-335c01c21479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58', 'volume_size': 1}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2054848797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b8e79c-c6a0-4da2-bca4-7a7840274b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934442e8953c420cb4d3fad83af50ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:16:37Z,use_quota=True,user_id='55ebbeb033dd4639b095ae728a96d7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Creating volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:16:37 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:16:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:37 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 1073741824
Jun 15 04:16:37 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:38 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 1073741824" returned: 0 in 0.828s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:38 devstack sudo[94659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58
Jun 15 04:16:38 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:38 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58" returned: 0 in 0.620s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76491c34-ab47-429f-b3d2-335c01c21479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffc0946-1d63-4005-b184-9ce0b249bd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:16:38 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Volume volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 (31b8e79c-c6a0-4da2-bca4-7a7840274b58): created successfully
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffc0946-1d63-4005-b184-9ce0b249bd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:16:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Flow 'volume_create_manager' (291615f5-d565-4c05-8dfa-d1145ce75c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:16:39 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-eab1e95c-1efb-4e45-b916-2ac6800cd7aa tempest-SnapshotsActionsTest-1134628267 None] Created volume successfully.
Jun 15 04:16:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Creating offline snapshot bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:16:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e21ffb-ea6c-44a7-bde1-0df3f7120c82]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:39 devstack sudo[94663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58
Jun 15 04:16:39 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:40 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58" returned: 0 in 0.762s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:40 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 1G
Jun 15 04:16:40 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:41 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 1G" returned: 0 in 0.774s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:41 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:16:41 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:42 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.946s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:42 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 is being set with open permissions: ugo+rw
Jun 15 04:16:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:42 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:16:42 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:42 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.763s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:42 devstack sudo[94776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info
Jun 15 04:16:42 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:43 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info" returned: 0 in 0.699s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:43 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info is being set with open permissions: ugo+rw
Jun 15 04:16:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:43 devstack sudo[94779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info
Jun 15 04:16:43 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:44 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.info" returned: 0 in 0.815s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.881s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c3877cee-4d46-40ae-82db-e2c912825f53 tempest-SnapshotsActionsTest-1134628267 None] Create snapshot completed successfully
Jun 15 04:16:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Creating offline snapshot 79e30706-933e-4a43-806f-17d5e41ac950 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:16:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3200162e-6501-4abf-b159-d65fa4a63cae]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:45 devstack sudo[94794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:16:45 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:46 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 1.365s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:46 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 1G
Jun 15 04:16:46 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:47 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 1G" returned: 0 in 1.009s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:48 devstack sudo[94875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950
Jun 15 04:16:48 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:48 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950" returned: 0 in 0.856s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:48 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 is being set with open permissions: ugo+rw
Jun 15 04:16:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:48 devstack sudo[94881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950
Jun 15 04:16:48 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:49 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950" returned: 0 in 0.635s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.028s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6a50df29-bc6f-401d-8783-fb8c5f91aede tempest-SnapshotsActionsTest-1134628267 None] Create snapshot completed successfully
Jun 15 04:16:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-79e30706-933e-4a43-806f-17d5e41ac950-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-79e30706-933e-4a43-806f-17d5e41ac950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" acquired by "delete_snapshot" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-79e30706-933e-4a43-806f-17d5e41ac950" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-79e30706-933e-4a43-806f-17d5e41ac950" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Deleting offline snapshot 79e30706-933e-4a43-806f-17d5e41ac950 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] snapshot_file for this snap is: volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[671870db-ba03-46f2-a59a-528d877284ee]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:50 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950
Jun 15 04:16:50 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:50 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950" returned: 0 in 0.736s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b78958-9fc6-451d-969d-bf8656906d04]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:51 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:16:51 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:51 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.744s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:51 devstack sudo[94895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950
Jun 15 04:16:51 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:52 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950" returned: 0 in 0.739s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:52 devstack sudo[94901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950
Jun 15 04:16:52 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:53 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.79e30706-933e-4a43-806f-17d5e41ac950" returned: 0 in 0.581s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-79e30706-933e-4a43-806f-17d5e41ac950" released by "_delete_snapshot" :: held 2.935s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" released by "delete_snapshot" :: held 2.978s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:53 devstack cinder-volume[92103]: WARNING cinder.quota [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Created reservations ['19624923-f747-4f68-9027-74a6bbe45328', '2abdf7dc-9480-45ff-a4a8-2453889532d6', '828f91c5-739e-4d49-a65c-9e26ac8f5d8c', '2d8bd18f-4eff-46a5-a90e-772c3a2609fb'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:16:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Delete snapshot completed successfully.
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e138e892-826a-4918-8569-669b21746dca tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-79e30706-933e-4a43-806f-17d5e41ac950-delete_snapshot" released by "delete_snapshot" :: held 3.150s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Creating offline snapshot 821c70d4-7b47-46d2-8501-4faf6897a3a7 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[24404248-64e2-4ce2-b038-52731855b639]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:53 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:16:53 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:54 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.848s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:54 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 1G
Jun 15 04:16:54 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:55 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 1G" returned: 0 in 0.817s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:55 devstack sudo[94957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7
Jun 15 04:16:55 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:56 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7" returned: 0 in 0.669s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:56 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 is being set with open permissions: ugo+rw
Jun 15 04:16:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:56 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7
Jun 15 04:16:56 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:56 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7" returned: 0 in 0.616s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.073s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:16:56 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cb652882-9d31-4d77-8f11-0cf65ff41f5e tempest-SnapshotsActionsTest-1134628267 None] Create snapshot completed successfully
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-821c70d4-7b47-46d2-8501-4faf6897a3a7-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-821c70d4-7b47-46d2-8501-4faf6897a3a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-821c70d4-7b47-46d2-8501-4faf6897a3a7" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-821c70d4-7b47-46d2-8501-4faf6897a3a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Deleting offline snapshot 821c70d4-7b47-46d2-8501-4faf6897a3a7 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] snapshot_file for this snap is: volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1383a1e5-971d-400c-bf29-b30c6e26e9ad]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:57 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7
Jun 15 04:16:57 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:57 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7" returned: 0 in 0.718s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d172ab-8fd8-40c5-9425-fb72021bc031]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:16:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:58 devstack sudo[94970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:16:58 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:58 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.702s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:16:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:58 devstack sudo[94976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7
Jun 15 04:16:58 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:59 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7" returned: 0 in 0.724s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:16:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:16:59 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7
Jun 15 04:16:59 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:16:59 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Jun 15 04:16:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.821c70d4-7b47-46d2-8501-4faf6897a3a7" returned: 0 in 0.614s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-821c70d4-7b47-46d2-8501-4faf6897a3a7" released by "_delete_snapshot" :: held 2.847s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" released by "delete_snapshot" :: held 2.868s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Created reservations ['bb5bea43-67d7-4b25-a6f5-93e3e2b3ca71', '3fc4b017-2faf-41d0-bb20-f4d1177902db', 'fbbd0fe7-66f5-4dfb-8abc-49186f74da04', 'c22d2494-05e1-41a9-be14-306d5d650037'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Delete snapshot completed successfully.
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7975bf5b-be09-428e-b9d6-5e2c013852dc tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-821c70d4-7b47-46d2-8501-4faf6897a3a7-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Creating offline snapshot b3b73d32-9fd3-428d-8283-6587c9dcccd9 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[642518bc-15c6-4e5a-b9a9-6b52a63b546d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:00 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:00 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:01 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.748s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:01 devstack sudo[94993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 1G
Jun 15 04:17:01 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:02 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 1G" returned: 0 in 0.874s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:02 devstack sudo[95002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9
Jun 15 04:17:02 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:02 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9" returned: 0 in 0.681s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:02 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 is being set with open permissions: ugo+rw
Jun 15 04:17:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:02 devstack sudo[95007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9
Jun 15 04:17:02 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:03 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9" returned: 0 in 0.614s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.019s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:03 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7ebbc945-3888-49ca-97ec-a124a626f6d7 tempest-SnapshotsActionsTest-1134628267 None] Create snapshot completed successfully
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-b3b73d32-9fd3-428d-8283-6587c9dcccd9-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-b3b73d32-9fd3-428d-8283-6587c9dcccd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-b3b73d32-9fd3-428d-8283-6587c9dcccd9" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-b3b73d32-9fd3-428d-8283-6587c9dcccd9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Deleting offline snapshot b3b73d32-9fd3-428d-8283-6587c9dcccd9 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] snapshot_file for this snap is: volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[256948c4-fe1d-4c01-af21-e88c092efeb1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:04 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9
Jun 15 04:17:04 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:04 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9" returned: 0 in 0.710s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88748f7-ade0-4e13-9be6-82ecadea6e7c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:04 devstack sudo[95015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:04 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:05 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.702s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:05 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9
Jun 15 04:17:05 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:06 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9" returned: 0 in 0.684s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:06 devstack sudo[95026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9
Jun 15 04:17:06 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:06 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.b3b73d32-9fd3-428d-8283-6587c9dcccd9" returned: 0 in 0.588s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-b3b73d32-9fd3-428d-8283-6587c9dcccd9" released by "_delete_snapshot" :: held 2.774s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" released by "delete_snapshot" :: held 2.801s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Created reservations ['384b849c-d7d8-4788-98d2-5b907eaca604', '8aca95c9-823b-4860-8ad9-71e50aecf28d', '3107b349-6c55-4b1a-bc15-758ad4826c1e', '458a712b-d241-43dd-a26b-a3e04a47d7f9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Delete snapshot completed successfully.
Jun 15 04:17:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4ad7b69a-3a97-42d7-a0cc-c77eb4660cf9 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-b3b73d32-9fd3-428d-8283-6587c9dcccd9-delete_snapshot" released by "delete_snapshot" :: held 2.939s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Flow 'volume_create_manager' (a3102529-2b34-47ce-af44-1553f06c572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4674b16-0ed4-4d65-ba36-e0ccdff32c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4674b16-0ed4-4d65-ba36-e0ccdff32c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2088147307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a76be3f-f8e1-4530-aea1-e1b5067317a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27bc2b4ca8114c67b86d4ebd4cf57911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:17:07Z,use_quota=True,user_id='e4870e6b70eb4b5bab02a4c1ad819f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a78479d-e653-4b33-8610-f3685891b651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a78479d-e653-4b33-8610-f3685891b651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7261d5e6-f443-4d4b-8422-6492c943c3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7261d5e6-f443-4d4b-8422-6492c943c3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a76be3f-f8e1-4530-aea1-e1b5067317a8', 'volume_name': 'volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265b3c5d-4954-40a0-b608-b87abf03e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265b3c5d-4954-40a0-b608-b87abf03e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb7c6af-85ce-41e5-a2ef-66f0a34b9f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:07 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Volume 2a76be3f-f8e1-4530-aea1-e1b5067317a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8', 'volume_size': 1}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2088147307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a76be3f-f8e1-4530-aea1-e1b5067317a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27bc2b4ca8114c67b86d4ebd4cf57911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:17:07Z,use_quota=True,user_id='e4870e6b70eb4b5bab02a4c1ad819f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Creating volume 2a76be3f-f8e1-4530-aea1-e1b5067317a8 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:17:07 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:07 devstack sudo[95032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 1073741824
Jun 15 04:17:07 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:08 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 1073741824" returned: 0 in 1.011s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:08 devstack sudo[95039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8
Jun 15 04:17:08 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:08 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8" returned: 0 in 0.599s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.287s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Creating offline snapshot 937520e1-4de2-43cc-b369-30086e419eaa of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb7c6af-85ce-41e5-a2ef-66f0a34b9f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b17380a-a96d-412a-8d8f-a573bfd166d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[924cd4e6-e8b3-40f2-b887-16f7e9911aae]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Volume volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 (2a76be3f-f8e1-4530-aea1-e1b5067317a8): created successfully
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b17380a-a96d-412a-8d8f-a573bfd166d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Flow 'volume_create_manager' (a3102529-2b34-47ce-af44-1553f06c572e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:17:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0b2546af-0d47-44af-abc8-828dd6ded4de tempest-ServerActionsTestOtherA-566947319 None] Created volume successfully.
Jun 15 04:17:08 devstack sudo[95042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:08 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:09 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.718s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:09 devstack sudo[95047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa 1G
Jun 15 04:17:09 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:10 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa 1G" returned: 0 in 0.869s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:10 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa
Jun 15 04:17:10 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:11 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa" returned: 0 in 0.645s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:11 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa is being set with open permissions: ugo+rw
Jun 15 04:17:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:11 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa
Jun 15 04:17:11 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:11 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa" returned: 0 in 0.732s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-203929a1-9b90-4033-bae5-b16aceac2821 tempest-SnapshotsActionsTest-1134628267 None] Create snapshot completed successfully
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-937520e1-4de2-43cc-b369-30086e419eaa-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-937520e1-4de2-43cc-b369-30086e419eaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Acquiring lock "cinder-quobyte-937520e1-4de2-43cc-b369-30086e419eaa" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-937520e1-4de2-43cc-b369-30086e419eaa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Deleting offline snapshot 937520e1-4de2-43cc-b369-30086e419eaa of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] snapshot_file for this snap is: volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c6cda-546b-4f5d-a142-67eed38fd62f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:12 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa
Jun 15 04:17:12 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:13 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa" returned: 0 in 0.791s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddacc92-95b3-410b-8541-61fa9c679c95]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:13 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:13 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:14 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.720s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:14 devstack sudo[95118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa
Jun 15 04:17:14 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:15 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa" returned: 0 in 0.755s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:15 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa
Jun 15 04:17:15 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:15 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.937520e1-4de2-43cc-b369-30086e419eaa" returned: 0 in 0.670s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-937520e1-4de2-43cc-b369-30086e419eaa" released by "_delete_snapshot" :: held 3.052s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" released by "delete_snapshot" :: held 3.076s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:15 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Created reservations ['f77ef055-e903-4702-8a0a-d0d65ed49b07', 'd066863f-910c-453c-bd6e-f5a6190becb0', '8e10d215-fcd6-4f42-829f-4437a0ef1090', '76f799b2-ee55-4a6a-b6a2-74d1f59643c0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Delete snapshot completed successfully.
Jun 15 04:17:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a9a0c39f-4bcd-4881-81a5-3d1e4361a890 tempest-SnapshotsActionsTest-2120210983 None] Lock "cinder-937520e1-4de2-43cc-b369-30086e419eaa-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "cinder-bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "cinder-quobyte-bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-quobyte-bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Deleting offline snapshot bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 of volume 31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] snapshot_file for this snap is: volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a25e9b-59bd-4256-9ea9-b0541c1ae053]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:17 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:17 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:18 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.779s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:18 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[994271dd-dbad-4e1a-ae16-f6bad34e6aa5]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:18 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58
Jun 15 04:17:18 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:19 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58" returned: 0 in 0.751s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:19 devstack sudo[95154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:19 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:19 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.748s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:19 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1
Jun 15 04:17:19 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:20 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58.bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" returned: 0 in 0.622s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-quobyte-bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1" released by "_delete_snapshot" :: held 3.011s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" released by "delete_snapshot" :: held 3.032s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:20 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Created reservations ['9d8ab6ba-ee82-4dc9-a954-f29acd0df2a0', 'cfa1b53a-926a-425c-8202-5c03e159cdc6', '662d0b35-cf44-4b9b-8b97-e9e6c7ef8da4', 'a4d4aaf5-194d-4df2-8396-f8cf9344b92c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Delete snapshot completed successfully.
Jun 15 04:17:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-346025c7-c5b6-4706-994b-84d458e2952a tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-bc53c5a7-8a98-48e9-bc70-5ab5e4c885a1-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "cinder-31b8e79c-c6a0-4da2-bca4-7a7840274b58-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-31b8e79c-c6a0-4da2-bca4-7a7840274b58-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" acquired by "delete_volume" :: waited 0.047s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:22 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51fb4e8-9ba6-4fdd-b8ff-5d8c8d7baf3e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:22 devstack sudo[95208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58
Jun 15 04:17:22 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:22 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58" returned: 0 in 0.893s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:23 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58
Jun 15 04:17:23 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:23 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-31b8e79c-c6a0-4da2-bca4-7a7840274b58" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-quobyte-31b8e79c-c6a0-4da2-bca4-7a7840274b58" released by "delete_volume" :: held 1.735s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Created reservations ['0abb6da0-c884-49e8-b864-0adb3b4a424e', '36baac43-cf15-4c75-b760-fc0ca484db22', 'd04b3e51-e59f-449d-ac8b-c0900c7801e6', 'b3c42eb9-da95-420d-a6c7-862dc6b0c2e2'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:23 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:17:23 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:24 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.974s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:24 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:17:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Deleted volume successfully.
Jun 15 04:17:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d1285372-3c8d-4231-85f8-f299afe2d8de tempest-SnapshotsActionsTest-1134628267 None] Lock "cinder-31b8e79c-c6a0-4da2-bca4-7a7840274b58-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:33 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=48,cinder:UPDATE=47,cinder:INSERT=14,cinder:DELETE=3 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:17:34 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=46,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=13 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:35 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:17:35 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Flow 'volume_create_manager' (84805b8e-e866-45b2-9726-de0ce54f4c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6fba07-b7fd-4697-81a0-87c93115faa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6fba07-b7fd-4697-81a0-87c93115faa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1664808329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44b0905-f0c4-4eab-91a1-d85cc82b5109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5fba2898d0476d8361c7d8b01864be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:17:36Z,use_quota=True,user_id='81d4d97f47ec4ab68e2581c06852f211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13b325a-84c1-42c0-9ce1-723075712628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13b325a-84c1-42c0-9ce1-723075712628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8885fd-ff1d-405e-b68b-775f7d7023e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8885fd-ff1d-405e-b68b-775f7d7023e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44b0905-f0c4-4eab-91a1-d85cc82b5109', 'volume_name': 'volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dc5c53-b26f-4d39-a32d-b037936ee66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dc5c53-b26f-4d39-a32d-b037936ee66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b88d7d-392d-4c81-8427-cbd3675d344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:35 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Volume e44b0905-f0c4-4eab-91a1-d85cc82b5109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109', 'volume_size': 1}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1664808329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44b0905-f0c4-4eab-91a1-d85cc82b5109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5fba2898d0476d8361c7d8b01864be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:17:36Z,use_quota=True,user_id='81d4d97f47ec4ab68e2581c06852f211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Creating volume e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:17:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:17:36 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:36 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 1073741824
Jun 15 04:17:36 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:36 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.175s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 8 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:17:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:17:37 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 1073741824" returned: 0 in 1.128s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:37 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109
Jun 15 04:17:37 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:37 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109" returned: 0 in 0.662s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b88d7d-392d-4c81-8427-cbd3675d344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2d106a-a8c2-4187-90fe-4587212796da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:17:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Volume volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 (e44b0905-f0c4-4eab-91a1-d85cc82b5109): created successfully
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2d106a-a8c2-4187-90fe-4587212796da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:17:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Flow 'volume_create_manager' (84805b8e-e866-45b2-9726-de0ce54f4c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:17:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3a3f1369-64cf-4d69-8128-ff1d4a970e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Created volume successfully.
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Creating offline snapshot 72d2abbf-7900-4764-993c-46a30a139d17 of volume e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b835fc8-8adb-45a2-b872-cfb9f777841b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:39 devstack sudo[95389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109
Jun 15 04:17:39 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:39 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109" returned: 0 in 0.789s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:39 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 1G
Jun 15 04:17:39 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:40 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 1G" returned: 0 in 0.802s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:40 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17
Jun 15 04:17:40 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:41 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17" returned: 0 in 0.653s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:41 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 is being set with open permissions: ugo+rw
Jun 15 04:17:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:41 devstack sudo[95408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17
Jun 15 04:17:41 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:41 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17" returned: 0 in 0.574s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:42 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info
Jun 15 04:17:42 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:42 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info" returned: 0 in 0.668s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:42 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info is being set with open permissions: ugo+rw
Jun 15 04:17:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:42 devstack sudo[95414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info
Jun 15 04:17:42 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:43 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.info" returned: 0 in 0.664s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.264s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:43 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d317c977-736a-4f58-b359-975e0b54c559 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Create snapshot completed successfully
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "cinder-72d2abbf-7900-4764-993c-46a30a139d17-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-72d2abbf-7900-4764-993c-46a30a139d17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "cinder-quobyte-e44b0905-f0c4-4eab-91a1-d85cc82b5109" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-quobyte-e44b0905-f0c4-4eab-91a1-d85cc82b5109" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "cinder-quobyte-72d2abbf-7900-4764-993c-46a30a139d17" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-quobyte-72d2abbf-7900-4764-993c-46a30a139d17" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Deleting offline snapshot 72d2abbf-7900-4764-993c-46a30a139d17 of volume e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] snapshot_file for this snap is: volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad564e9f-9759-4d14-801e-3ebe5ae25e03]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:44 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17
Jun 15 04:17:44 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:45 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17" returned: 0 in 0.737s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:17:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[de331967-0787-4f9f-920c-774995a93c23]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:45 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109
Jun 15 04:17:45 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:46 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109" returned: 0 in 0.739s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:46 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17
Jun 15 04:17:46 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:47 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17" returned: 0 in 0.791s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:47 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17
Jun 15 04:17:47 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:47 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109.72d2abbf-7900-4764-993c-46a30a139d17" returned: 0 in 0.624s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-quobyte-72d2abbf-7900-4764-993c-46a30a139d17" released by "_delete_snapshot" :: held 2.995s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-quobyte-e44b0905-f0c4-4eab-91a1-d85cc82b5109" released by "delete_snapshot" :: held 3.032s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Created reservations ['bea341b6-7287-4770-9b93-ea2967e210b6', '61573c4e-bd73-4e80-a671-f68e883e4a69', '16da89a2-f972-4275-9f4a-5ad0648d819b', 'f81690f7-35dc-41fb-a221-e06c5c804af0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Delete snapshot completed successfully.
Jun 15 04:17:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-efe8925c-4e58-4890-a6e3-9d7235c11820 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-72d2abbf-7900-4764-993c-46a30a139d17-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "cinder-e44b0905-f0c4-4eab-91a1-d85cc82b5109-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-e44b0905-f0c4-4eab-91a1-d85cc82b5109-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "cinder-quobyte-e44b0905-f0c4-4eab-91a1-d85cc82b5109" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:17:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-quobyte-e44b0905-f0c4-4eab-91a1-d85cc82b5109" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:17:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e28f3d4-b4ea-403a-b058-943e586c2f84]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:49 devstack sudo[95483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109
Jun 15 04:17:49 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:50 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109" returned: 0 in 0.706s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:50 devstack sudo[95497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109
Jun 15 04:17:50 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e851e4-4ead-4501-b88e-3f92ba7c2b4f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:50 devstack sudo[95499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8
Jun 15 04:17:50 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:50 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e44b0905-f0c4-4eab-91a1-d85cc82b5109" returned: 0 in 0.632s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-quobyte-e44b0905-f0c4-4eab-91a1-d85cc82b5109" released by "delete_volume" :: held 1.445s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Created reservations ['9fdfc5ab-355e-443d-a9c2-24a9f3b7f1c9', '77f57aed-6acd-4b36-a747-14ea3b1a878f', '985ea5a1-d8e6-4516-ab6d-8f875ba9ee2f', '786c18b5-60bd-4622-a749-211dd597c826'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:17:50 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:17:50 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:17:50 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8" returned: 0 in 0.792s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:17:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f880f65-f665-496b-a60a-3893f0e3718a', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:17:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-5e241b1f-c414-43f6-82d7-1f396af634c7 req-d6cce0a3-89c8-45ea-add1-6c5c90d4c241 tempest-ServerActionsTestOtherA-566947319 None] attachment_update completed successfully.
Jun 15 04:17:51 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Jun 15 04:17:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.650s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:17:51 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:17:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Deleted volume successfully.
Jun 15 04:17:51 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a580fd4-8687-422d-be32-7ad92f881314 tempest-VolumeSnapshotQuotasNegativeTestJSON-1984073655 None] Lock "cinder-e44b0905-f0c4-4eab-91a1-d85cc82b5109-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:17:58 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-0bda1a75-c91d-4861-8ac2-f5331370e505 tempest-ServerActionsTestOtherA-566947319 None] Terminate volume connection completed successfully.
Jun 15 04:17:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-0bda1a75-c91d-4861-8ac2-f5331370e505 tempest-ServerActionsTestOtherA-566947319 None] Deleting attachment 8f880f65-f665-496b-a60a-3893f0e3718a. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Flow 'volume_create_manager' (3cba9737-2a95-4180-989e-0dd2d4a419cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3063c8-c27f-41c7-8bc6-0fcd862581f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3063c8-c27f-41c7-8bc6-0fcd862581f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1824106251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d3c480-499f-49e7-ae39-b76848b129f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1632285ef64e6eaf807fe0ddd2c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:00Z,use_quota=True,user_id='9eb3b80bfd0a4817839ce7f4fea1c4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5271a23-a952-4350-b5d7-960a57946209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5271a23-a952-4350-b5d7-960a57946209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bd72c1-4778-4614-ae85-94e2ad4bbeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bd72c1-4778-4614-ae85-94e2ad4bbeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d3c480-499f-49e7-ae39-b76848b129f1', 'volume_name': 'volume-84d3c480-499f-49e7-ae39-b76848b129f1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5291ecf2-eb96-422d-a589-6381e352edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5291ecf2-eb96-422d-a589-6381e352edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d64a5a-70a2-478a-a46f-a01941a706c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Volume 84d3c480-499f-49e7-ae39-b76848b129f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d3c480-499f-49e7-ae39-b76848b129f1', 'volume_size': 1}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1824106251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d3c480-499f-49e7-ae39-b76848b129f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1632285ef64e6eaf807fe0ddd2c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:00Z,use_quota=True,user_id='9eb3b80bfd0a4817839ce7f4fea1c4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Creating volume 84d3c480-499f-49e7-ae39-b76848b129f1 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:00 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:00 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 1073741824
Jun 15 04:18:00 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:01 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 1073741824" returned: 0 in 0.843s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:01 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1
Jun 15 04:18:01 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Flow 'volume_create_manager' (bbcc9300-0f0e-449c-97c5-47d8a6d99992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6f1667-a78f-4a1f-82c3-7fedb11291ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6f1667-a78f-4a1f-82c3-7fedb11291ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-383495188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b93a2e4-9293-41a9-92ec-b625a0b59e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e412e06e5343679c12275e0e983b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:01Z,use_quota=True,user_id='85ac61e7fb1940e3aad4fa259fd22e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34c2eed-5c44-4b70-ab5d-58de6880b0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34c2eed-5c44-4b70-ab5d-58de6880b0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0381a3-8e05-4253-9af1-ddfc8dea09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:18:01 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1" returned: 0 in 0.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.663s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d64a5a-70a2-478a-a46f-a01941a706c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d3c480-499f-49e7-ae39-b76848b129f1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4cef7f-bdba-488b-990b-b99419d78130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf388b6-c1e1-4d37-bc5e-5f84bd6e4fba]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:01 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Volume volume-84d3c480-499f-49e7-ae39-b76848b129f1 (84d3c480-499f-49e7-ae39-b76848b129f1): created successfully
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4cef7f-bdba-488b-990b-b99419d78130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Flow 'volume_create_manager' (3cba9737-2a95-4180-989e-0dd2d4a419cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c10b8f7b-655f-4229-8770-d9a27236eb91 tempest-AttachVolumeTestJSON-362422834 None] Created volume successfully.
Jun 15 04:18:01 devstack sudo[95970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8
Jun 15 04:18:01 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0381a3-8e05-4253-9af1-ddfc8dea09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b93a2e4-9293-41a9-92ec-b625a0b59e52', 'volume_name': 'volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdb90650>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9738555-5770-4527-95de-4ccedc499ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9738555-5770-4527-95de-4ccedc499ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166fc8c3-eb68-4c8b-a14b-a4b7610f5a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Volume 2b93a2e4-9293-41a9-92ec-b625a0b59e52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdb90650>}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Trying to clone 2b93a2e4-9293-41a9-92ec-b625a0b59e52 from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:18:02 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14de4e6-b065-4105-8a46-8f04c38d16ec]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:02 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8" returned: 0 in 0.743s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '006f3c5d-647a-4178-b819-313eb2aafb74', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:18:02 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD
Jun 15 04:18:02 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-89b8cc63-79be-4d3e-aa3c-c08a60747ed2 req-4c7af4ad-63f9-44d0-bed8-c8bc3d0f555c tempest-ServerActionsTestOtherA-566947319 None] attachment_update completed successfully.
Jun 15 04:18:03 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD" returned: 0 in 0.682s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde is fetched for user 85ac61e7fb1940e3aad4fa259fd22e54. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73e220-242c-4ad6-b67c-ba3dcb33740c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:03 devstack sudo[96002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD
Jun 15 04:18:03 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:03 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD" returned: 0 in 0.658s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-383495188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b93a2e4-9293-41a9-92ec-b625a0b59e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e412e06e5343679c12275e0e983b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:01Z,use_quota=True,user_id='85ac61e7fb1940e3aad4fa259fd22e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Creating volume 2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:03 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:03 devstack sudo[96007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 1073741824
Jun 15 04:18:03 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:04 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 1073741824" returned: 0 in 0.762s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:04 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:04 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:05 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 0 in 0.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Attempting download of 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume 2b93a2e4-9293-41a9-92ec-b625a0b59e52. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a264b4d8-6f1c-4893-acc1-7a8908a57d86]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:05 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz
Jun 15 04:18:05 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381504c-4792-42ec-96ed-bdd6ba80cc8e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:05 devstack sudo[96054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1
Jun 15 04:18:05 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:06 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz" returned: 0 in 0.682s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:06 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz
Jun 15 04:18:06 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:06 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1" returned: 0 in 0.739s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.758s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-84d3c480-499f-49e7-ae39-b76848b129f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8a297e4-c9be-4d56-bd03-3d98d2ae082b', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:18:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-763adb1d-5269-4a43-b95f-3f9d130bc07f req-d68b7c69-988e-4ddc-9c4b-112939cc4aa1 tempest-AttachVolumeTestJSON-362422834 None] attachment_update completed successfully.
Jun 15 04:18:06 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz" returned: 1 in 0.736s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_87gcsvkz' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5e0a9-f0f8-462b-bc97-0be3daf903db]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:06 devstack sudo[96135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD
Jun 15 04:18:06 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:07 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:07 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] 0ad3d500-cd6a-4357-9bcb-50810aab8cde was qcow2, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:18:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:07 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:07 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:09 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 0 in 2.195s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:09 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_pnfpbxt6devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:18:09 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Converted 112.00 MB image at 50.98 MB/s
Jun 15 04:18:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:09 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 1G
Jun 15 04:18:09 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:10 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 1G" returned: 0 in 0.696s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:10 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058e836-6310-4603-b24d-96a430bf5260]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:10 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:10 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:11 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 0 in 0.806s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:11 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:11 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Flow 'volume_create_manager' (c5e028eb-01bc-4cc0-a18c-ce3b8467ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fabd5fc-a201-487c-82c7-625562461d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fabd5fc-a201-487c-82c7-625562461d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1761472582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ea9afb-0401-48b6-95a9-cc4aa60cda14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1632285ef64e6eaf807fe0ddd2c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:11Z,use_quota=True,user_id='9eb3b80bfd0a4817839ce7f4fea1c4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c0c5f3-71cd-4930-87b4-62fc2d36c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c0c5f3-71cd-4930-87b4-62fc2d36c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1171de6f-f659-4dd4-97e2-240647bf7a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1171de6f-f659-4dd4-97e2-240647bf7a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ea9afb-0401-48b6-95a9-cc4aa60cda14', 'volume_name': 'volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792bc8d4-8cff-421e-a847-af3dc3d251bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792bc8d4-8cff-421e-a847-af3dc3d251bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ba2134-5e65-486c-b931-ba2e2b2f22da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:11 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Volume 62ea9afb-0401-48b6-95a9-cc4aa60cda14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14', 'volume_size': 1}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1761472582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ea9afb-0401-48b6-95a9-cc4aa60cda14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1632285ef64e6eaf807fe0ddd2c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:11Z,use_quota=True,user_id='9eb3b80bfd0a4817839ce7f4fea1c4d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Creating volume 62ea9afb-0401-48b6-95a9-cc4aa60cda14 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:11 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:11 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 1073741824
Jun 15 04:18:11 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:12 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 1 in 0.931s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Downloaded image 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume 2b93a2e4-9293-41a9-92ec-b625a0b59e52 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde for user 85ac61e7fb1940e3aad4fa259fd22e54 is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Marking volume 2b93a2e4-9293-41a9-92ec-b625a0b59e52 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Copying metadata from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde to 2b93a2e4-9293-41a9-92ec-b625a0b59e52. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Creating volume glance metadata for volume 2b93a2e4-9293-41a9-92ec-b625a0b59e52 backed by image 0ad3d500-cd6a-4357-9bcb-50810aab8cde with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166fc8c3-eb68-4c8b-a14b-a4b7610f5a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdb90650>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e87a8-c33a-4e8f-b7f3-ba44884a8d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:12 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Volume volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 (2b93a2e4-9293-41a9-92ec-b625a0b59e52): created successfully
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e87a8-c33a-4e8f-b7f3-ba44884a8d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Flow 'volume_create_manager' (bbcc9300-0f0e-449c-97c5-47d8a6d99992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:12 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-76728bbf-2077-43da-be76-816df96e965b tempest-VolumesImageMetadata-1354040532 None] Created volume successfully.
Jun 15 04:18:12 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 1073741824" returned: 0 in 0.873s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:12 devstack sudo[96526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14
Jun 15 04:18:12 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:13 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14" returned: 0 in 0.598s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ba2134-5e65-486c-b931-ba2e2b2f22da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69298e8-508a-4144-8d1f-b31c10eadabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:13 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Volume volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 (62ea9afb-0401-48b6-95a9-cc4aa60cda14): created successfully
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69298e8-508a-4144-8d1f-b31c10eadabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Flow 'volume_create_manager' (c5e028eb-01bc-4cc0-a18c-ce3b8467ca30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c37baa35-fb1c-4c5f-bf03-ba310c06a04f tempest-AttachVolumeTestJSON-362422834 None] Created volume successfully.
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Acquiring lock "cinder-2b93a2e4-9293-41a9-92ec-b625a0b59e52-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Lock "cinder-2b93a2e4-9293-41a9-92ec-b625a0b59e52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Acquiring lock "cinder-quobyte-2b93a2e4-9293-41a9-92ec-b625a0b59e52" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Lock "cinder-quobyte-2b93a2e4-9293-41a9-92ec-b625a0b59e52" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe2f909-d753-4fb7-99ad-5fce87017a7b]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:13 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:13 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:14 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 0 in 0.720s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:14 devstack sudo[96533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:14 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:15 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 1 in 0.720s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:18:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:15 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52
Jun 15 04:18:15 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:15 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b93a2e4-9293-41a9-92ec-b625a0b59e52" returned: 0 in 0.641s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Lock "cinder-quobyte-2b93a2e4-9293-41a9-92ec-b625a0b59e52" released by "delete_volume" :: held 2.154s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:15 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Created reservations ['d2a0c076-69ba-444f-af0d-d1ac6485dfc6', '5d70d0d5-f897-4de7-9fde-8b072ee83e1a', 'f61a12b2-c2d6-4b6d-8d9b-6380028bb521', 'f92f5b7d-e99a-4d30-b5e7-9e8ffe9fb423'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:16 devstack sudo[96541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:16 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:16 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.601s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Deleted volume successfully.
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2af95239-8f1c-422d-8540-f12421b54bee tempest-VolumesImageMetadata-1354040532 None] Lock "cinder-2b93a2e4-9293-41a9-92ec-b625a0b59e52-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[23665578-1da4-4418-a2e0-797b345ec68b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:16 devstack sudo[96552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14
Jun 15 04:18:16 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:17 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14" returned: 0 in 0.762s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91a38e98-dd9f-4ba5-9dee-a30823731795', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:18:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-c013d4c7-9653-4fc4-a194-0d056da64459 req-1e36d2b1-78e0-4fc9-858a-d748447e9388 tempest-AttachVolumeTestJSON-362422834 None] attachment_update completed successfully.
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Flow 'volume_create_manager' (fc04d8bd-3cc2-4141-b0de-370ccda69fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce83d1f-b141-46f8-842c-638925c6af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce83d1f-b141-46f8-842c-638925c6af9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-305296784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db8012-8c1b-48de-8e7c-203f7e6f28a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a8f1f27cab41af963a67c532dfabc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:20Z,use_quota=True,user_id='41fb76b704bf435faed37e8e6c75d71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c33f41-ac9c-4f7f-b0e4-a67a2e77b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c33f41-ac9c-4f7f-b0e4-a67a2e77b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5677089d-b6f9-4957-a337-a1c496970555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5677089d-b6f9-4957-a337-a1c496970555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8db8012-8c1b-48de-8e7c-203f7e6f28a8', 'volume_name': 'volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076ba174-9a57-491c-995a-a8c26bc455ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076ba174-9a57-491c-995a-a8c26bc455ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9471b90-89e5-42ba-a624-e8e4875c0b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:20 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Volume e8db8012-8c1b-48de-8e7c-203f7e6f28a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8', 'volume_size': 1}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-305296784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8db8012-8c1b-48de-8e7c-203f7e6f28a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a8f1f27cab41af963a67c532dfabc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:20Z,use_quota=True,user_id='41fb76b704bf435faed37e8e6c75d71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Creating volume e8db8012-8c1b-48de-8e7c-203f7e6f28a8 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:20 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:20 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 1073741824
Jun 15 04:18:20 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:20 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 1073741824" returned: 0 in 0.801s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:20 devstack sudo[96565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8
Jun 15 04:18:20 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:21 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8" returned: 0 in 0.619s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9471b90-89e5-42ba-a624-e8e4875c0b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6e4cf8-55c1-48ae-941f-d19e187a0ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Volume volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 (e8db8012-8c1b-48de-8e7c-203f7e6f28a8): created successfully
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6e4cf8-55c1-48ae-941f-d19e187a0ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Flow 'volume_create_manager' (fc04d8bd-3cc2-4141-b0de-370ccda69fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:21 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f0c9ed56-f48d-4cf3-90e0-ea368b0d26c5 tempest-VolumesMetadataTest-1248769575 None] Created volume successfully.
Jun 15 04:18:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Acquiring lock "cinder-e8db8012-8c1b-48de-8e7c-203f7e6f28a8-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Lock "cinder-e8db8012-8c1b-48de-8e7c-203f7e6f28a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Acquiring lock "cinder-quobyte-e8db8012-8c1b-48de-8e7c-203f7e6f28a8" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Lock "cinder-quobyte-e8db8012-8c1b-48de-8e7c-203f7e6f28a8" acquired by "delete_volume" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:22 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2d109-fa85-4f57-9cf7-dd807831c433]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:23 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8
Jun 15 04:18:23 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:23 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8" returned: 0 in 0.740s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:23 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8
Jun 15 04:18:23 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-593ac094-1d74-4fb6-917e-1156ac7bcc80 req-1fd14179-147c-4839-9e1e-f09851ea0ccd tempest-AttachVolumeTestJSON-362422834 None] Terminate volume connection completed successfully.
Jun 15 04:18:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-593ac094-1d74-4fb6-917e-1156ac7bcc80 req-1fd14179-147c-4839-9e1e-f09851ea0ccd tempest-AttachVolumeTestJSON-362422834 None] Deleting attachment e8a297e4-c9be-4d56-bd03-3d98d2ae082b. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:18:24 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e8db8012-8c1b-48de-8e7c-203f7e6f28a8" returned: 0 in 0.597s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Lock "cinder-quobyte-e8db8012-8c1b-48de-8e7c-203f7e6f28a8" released by "delete_volume" :: held 1.377s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Created reservations ['fbca9028-884d-4c66-b6aa-80baad99284e', 'c66b1f89-658b-4699-83e6-033123beafef', '051690ba-4993-4c7c-acdb-af9d6ec68841', 'd5724e11-7393-434d-9523-5c193f013fd0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:24 devstack sudo[96610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:24 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:24 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.593s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:24 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Deleted volume successfully.
Jun 15 04:18:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46d86b43-7e9b-4253-8bc9-babf15f61e27 tempest-VolumesMetadataTest-1248769575 None] Lock "cinder-e8db8012-8c1b-48de-8e7c-203f7e6f28a8-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:26 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-f5c10f30-f386-446d-a321-87300f8a9e78 req-403ca84d-c6a2-4f5e-ba02-a660dd208513 tempest-AttachVolumeTestJSON-362422834 None] Terminate volume connection completed successfully.
Jun 15 04:18:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-f5c10f30-f386-446d-a321-87300f8a9e78 req-403ca84d-c6a2-4f5e-ba02-a660dd208513 tempest-AttachVolumeTestJSON-362422834 None] Deleting attachment 91a38e98-dd9f-4ba5-9dee-a30823731795. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Flow 'volume_create_manager' (24d5ec4b-4a88-4eae-a820-1c8e3ac3f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4169912d-bdb9-49a5-9b07-f090528ec99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4169912d-bdb9-49a5-9b07-f090528ec99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1223992388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55964810-b8f0-4e1e-8107-962ca08c9357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fcab10e93c48b3ac3bd578a76a9db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:29Z,use_quota=True,user_id='b6553345451d41a3905b2bebecb90ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3c1dcd-f5e2-45de-8a31-1907d0d01dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3c1dcd-f5e2-45de-8a31-1907d0d01dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2bc98c-a3a0-4cfc-801c-0de979645c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2bc98c-a3a0-4cfc-801c-0de979645c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55964810-b8f0-4e1e-8107-962ca08c9357', 'volume_name': 'volume-55964810-b8f0-4e1e-8107-962ca08c9357', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81533ddc-0cd5-435d-85d9-385d6209b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81533ddc-0cd5-435d-85d9-385d6209b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22c9479-90c0-4f05-8b76-bf6f5c78089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Volume 55964810-b8f0-4e1e-8107-962ca08c9357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55964810-b8f0-4e1e-8107-962ca08c9357', 'volume_size': 1}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1223992388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55964810-b8f0-4e1e-8107-962ca08c9357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fcab10e93c48b3ac3bd578a76a9db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:29Z,use_quota=True,user_id='b6553345451d41a3905b2bebecb90ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Creating volume 55964810-b8f0-4e1e-8107-962ca08c9357 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:29 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:29 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357 1073741824
Jun 15 04:18:29 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:30 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357 1073741824" returned: 0 in 1.012s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:30 devstack sudo[96684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357
Jun 15 04:18:30 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:30 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357" returned: 0 in 0.708s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22c9479-90c0-4f05-8b76-bf6f5c78089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55964810-b8f0-4e1e-8107-962ca08c9357', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a489ed-3177-4bec-a2af-3c08f8291568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Volume volume-55964810-b8f0-4e1e-8107-962ca08c9357 (55964810-b8f0-4e1e-8107-962ca08c9357): created successfully
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a489ed-3177-4bec-a2af-3c08f8291568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Flow 'volume_create_manager' (24d5ec4b-4a88-4eae-a820-1c8e3ac3f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-018f5528-308f-4b06-8555-3adaa93300e4 tempest-VolumesTransfersTest-1203012633 None] Created volume successfully.
Jun 15 04:18:31 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c9707d5c-6b5c-4a2d-bfbb-b56da422eed3 tempest-VolumesTransfersTest-885861713 None] Transfer volume completed successfully.
Jun 15 04:18:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Acquiring lock "cinder-55964810-b8f0-4e1e-8107-962ca08c9357-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-55964810-b8f0-4e1e-8107-962ca08c9357-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Acquiring lock "cinder-quobyte-55964810-b8f0-4e1e-8107-962ca08c9357" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-quobyte-55964810-b8f0-4e1e-8107-962ca08c9357" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f1e00-e227-439d-9f8d-e6db268733ea]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:33 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357
Jun 15 04:18:33 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:33 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357" returned: 0 in 0.700s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:33 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357
Jun 15 04:18:33 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:34 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-55964810-b8f0-4e1e-8107-962ca08c9357" returned: 0 in 0.589s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-quobyte-55964810-b8f0-4e1e-8107-962ca08c9357" released by "delete_volume" :: held 1.329s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=73,cinder:UPDATE=58,cinder:INSERT=22,cinder:DELETE=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Created reservations ['2200a353-361f-4ee2-8b61-5d640290c5af', '489943ec-cedc-4aae-be7e-81aa4e7ec56a', 'dbee3825-47e0-422f-85b1-e53bcf1390e0', '6a2d880d-d4f5-4124-8b0e-20e626b4e68e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:34 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:34 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:35 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:35 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Deleted volume successfully.
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=67,cinder:SELECT=73,cinder:INSERT=16,cinder:DELETE=9 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5e4ef502-d250-4e69-ae37-728fb5361f19 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-55964810-b8f0-4e1e-8107-962ca08c9357-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:35 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:35 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Flow 'volume_create_manager' (2358f2e8-cc94-4255-914d-b1372827c90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc6a57f-9303-4f8f-b382-7b9843d20980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc6a57f-9303-4f8f-b382-7b9843d20980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-769351738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a12160e-e7ea-4fe5-ac4b-20659fe450c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fcab10e93c48b3ac3bd578a76a9db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:36Z,use_quota=True,user_id='b6553345451d41a3905b2bebecb90ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eeb5a7-dada-4d03-b16a-c731824d5e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eeb5a7-dada-4d03-b16a-c731824d5e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702d0565-a1f3-4fb5-9ef9-acf13f20bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702d0565-a1f3-4fb5-9ef9-acf13f20bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a12160e-e7ea-4fe5-ac4b-20659fe450c8', 'volume_name': 'volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56528e4-660a-473c-9bc6-5aaa639f3c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56528e4-660a-473c-9bc6-5aaa639f3c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7497b7a-fb79-411d-ad1b-49289a161da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:35 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Volume 9a12160e-e7ea-4fe5-ac4b-20659fe450c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8', 'volume_size': 1}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-769351738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a12160e-e7ea-4fe5-ac4b-20659fe450c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fcab10e93c48b3ac3bd578a76a9db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:36Z,use_quota=True,user_id='b6553345451d41a3905b2bebecb90ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Creating volume 9a12160e-e7ea-4fe5-ac4b-20659fe450c8 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:35 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:35 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 1073741824
Jun 15 04:18:35 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:36 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:18:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-d7a42d37-0057-407b-a6fc-3af89b439ebc req-d83b46e2-67f3-427f-8d55-13084213fc6b tempest-ServerActionsTestOtherA-566947319 None] Terminate volume connection completed successfully.
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d7a42d37-0057-407b-a6fc-3af89b439ebc req-d83b46e2-67f3-427f-8d55-13084213fc6b tempest-ServerActionsTestOtherA-566947319 None] Deleting attachment 006f3c5d-647a-4178-b819-313eb2aafb74. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:18:36 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 1073741824" returned: 0 in 0.902s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:36 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8
Jun 15 04:18:36 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "cinder-62ea9afb-0401-48b6-95a9-cc4aa60cda14-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-62ea9afb-0401-48b6-95a9-cc4aa60cda14-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "cinder-quobyte-62ea9afb-0401-48b6-95a9-cc4aa60cda14" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:37 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-quobyte-62ea9afb-0401-48b6-95a9-cc4aa60cda14" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8" returned: 0 in 0.631s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7497b7a-fb79-411d-ad1b-49289a161da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b124b54-15d7-4362-9edb-1dadcdb94f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[16111b85-e555-477f-92b6-2e599da239c6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Volume volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 (9a12160e-e7ea-4fe5-ac4b-20659fe450c8): created successfully
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b124b54-15d7-4362-9edb-1dadcdb94f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Flow 'volume_create_manager' (2358f2e8-cc94-4255-914d-b1372827c90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-28bcd56f-df7f-40ff-9fd9-e49ac57e1306 tempest-VolumesTransfersTest-1203012633 None] Created volume successfully.
Jun 15 04:18:37 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14
Jun 15 04:18:37 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:37 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14" returned: 0 in 0.715s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:38 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14
Jun 15 04:18:38 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Acquiring lock "cinder-9a12160e-e7ea-4fe5-ac4b-20659fe450c8-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-9a12160e-e7ea-4fe5-ac4b-20659fe450c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Acquiring lock "cinder-quobyte-9a12160e-e7ea-4fe5-ac4b-20659fe450c8" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-quobyte-9a12160e-e7ea-4fe5-ac4b-20659fe450c8" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[657e7412-622f-4844-82cf-22dc9b5eaf05]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:38 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8
Jun 15 04:18:38 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:38 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-62ea9afb-0401-48b6-95a9-cc4aa60cda14" returned: 0 in 0.643s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-quobyte-62ea9afb-0401-48b6-95a9-cc4aa60cda14" released by "delete_volume" :: held 1.413s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Created reservations ['8e86b7da-9e09-4e18-941f-5995deea2d3c', '9d5e857b-f95c-4430-af8b-025a42b86c94', '99989649-8dae-4879-bfeb-f317fb922530', '9e4e03fc-aa66-4e2c-8321-87c46bf6e1a8'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:38 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:38 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:38 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8" returned: 0 in 0.815s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:38 devstack sudo[96769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8
Jun 15 04:18:38 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:39 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.587s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:39 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Deleted volume successfully.
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b8bc3a1b-34ec-4c48-a4ca-b4813bb799b2 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-62ea9afb-0401-48b6-95a9-cc4aa60cda14-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "cinder-84d3c480-499f-49e7-ae39-b76848b129f1-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-84d3c480-499f-49e7-ae39-b76848b129f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "cinder-quobyte-84d3c480-499f-49e7-ae39-b76848b129f1" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-quobyte-84d3c480-499f-49e7-ae39-b76848b129f1" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1163b3-5ea8-4048-a8eb-daed81f65d92]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:39 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9a12160e-e7ea-4fe5-ac4b-20659fe450c8" returned: 0 in 0.702s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-quobyte-9a12160e-e7ea-4fe5-ac4b-20659fe450c8" released by "delete_volume" :: held 1.583s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:39 devstack sudo[96773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1
Jun 15 04:18:39 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Created reservations ['e83f2dbf-361e-4402-8959-5a9f96e710c1', '6eeb9e8a-b0ff-480c-bc1c-075d896284b4', '439fe009-b233-42f3-82af-89bbce589a7d', '90f27a7a-de13-49cb-ab39-4cad21ae7ddd'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:39 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:39 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:40 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1" returned: 0 in 1.077s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:40 devstack sudo[96816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1
Jun 15 04:18:40 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:40 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:40 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Deleted volume successfully.
Jun 15 04:18:40 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-de188c0a-9951-4c2c-b5ac-8399dde10da2 tempest-VolumesTransfersTest-917914673 None] Lock "cinder-9a12160e-e7ea-4fe5-ac4b-20659fe450c8-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:41 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-84d3c480-499f-49e7-ae39-b76848b129f1" returned: 0 in 0.637s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-quobyte-84d3c480-499f-49e7-ae39-b76848b129f1" released by "delete_volume" :: held 1.761s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Created reservations ['ecd55f78-8dbf-4d02-ad15-f4570a8c3a51', '02d78aee-7af5-4e60-bcbc-668cede1247f', 'fdf34ea6-075d-4071-a1c7-8780c5f0251a', '21b202cf-0887-46fa-bda2-6e611d566995'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:41 devstack sudo[96819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:41 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "cinder-fec1a6ee-4d17-4054-98eb-9b0da935b8dc-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-fec1a6ee-4d17-4054-98eb-9b0da935b8dc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "cinder-quobyte-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-quobyte-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b0998-a2d2-4e95-9301-dc4d6bad8ea6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:42 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc
Jun 15 04:18:42 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:42 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.794s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Deleted volume successfully.
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bffa18ab-41b7-4906-b572-ea9c7b4c500b tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-84d3c480-499f-49e7-ae39-b76848b129f1-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:42 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" returned: 0 in 0.771s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:42 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc
Jun 15 04:18:42 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:43 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" returned: 0 in 0.651s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-quobyte-fec1a6ee-4d17-4054-98eb-9b0da935b8dc" released by "delete_volume" :: held 1.492s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Created reservations ['4fed733b-20ee-4cbd-905d-4ce936c91a7f', 'e41c1897-0166-4121-a84a-cd98c34662e0', '3fef9438-16aa-4aa1-949d-ad60924c4ea1', '32eff553-ca1e-4c6e-ac6b-b212b0c0e103'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:43 devstack sudo[96832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:43 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:44 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.661s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:44 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Deleted volume successfully.
Jun 15 04:18:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e495964d-489b-416f-bfa8-9ca6bcf5f738 tempest-AttachVolumeTestJSON-362422834 None] Lock "cinder-fec1a6ee-4d17-4054-98eb-9b0da935b8dc-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "cinder-2a76be3f-f8e1-4530-aea1-e1b5067317a8-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Lock "cinder-2a76be3f-f8e1-4530-aea1-e1b5067317a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "cinder-quobyte-2a76be3f-f8e1-4530-aea1-e1b5067317a8" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Lock "cinder-quobyte-2a76be3f-f8e1-4530-aea1-e1b5067317a8" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2613fea-5c2e-464d-9068-0bfe29f52e44]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:49 devstack sudo[96852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8
Jun 15 04:18:49 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:50 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8" returned: 0 in 0.861s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:50 devstack sudo[96858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8
Jun 15 04:18:50 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:50 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2a76be3f-f8e1-4530-aea1-e1b5067317a8" returned: 0 in 0.648s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Lock "cinder-quobyte-2a76be3f-f8e1-4530-aea1-e1b5067317a8" released by "delete_volume" :: held 1.564s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Created reservations ['35439864-151f-40b0-8399-2d5fbaa7ba1d', 'ad53d8fc-d1dc-4eff-b726-ec72d6e16999', '847e84cb-9763-4665-b4e9-b902d0126f54', 'f261d9dd-8200-4f56-b283-939180ba7a5c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:50 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:18:50 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:51 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.837s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:51 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:18:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Deleted volume successfully.
Jun 15 04:18:51 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-490be69f-3910-455b-98e9-5800c0a211c5 tempest-ServerActionsTestOtherA-566947319 None] Lock "cinder-2a76be3f-f8e1-4530-aea1-e1b5067317a8-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Flow 'volume_create_manager' (b6282121-8daa-4016-bd7f-7130aa1c5c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990c9bb7-eec6-4dc4-9e6c-639662b39221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990c9bb7-eec6-4dc4-9e6c-639662b39221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-830780035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb2283e-e174-479a-96fe-a7d5004c3b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba603302918488bbabb4de05dc9e4ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:52Z,use_quota=True,user_id='07e5899824514a4e9600306a1451fe5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc053bd-959c-4b20-87be-ac04d1ec0f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc053bd-959c-4b20-87be-ac04d1ec0f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26e4a4-61b3-41fe-b89a-0706a1c8d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26e4a4-61b3-41fe-b89a-0706a1c8d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb2283e-e174-479a-96fe-a7d5004c3b2f', 'volume_name': 'volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1a0c51-3d41-4c4b-9441-8843dd4c65fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1a0c51-3d41-4c4b-9441-8843dd4c65fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0e5b55-b4c7-4e3e-af29-ba02ad1d9fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:52 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Volume 0bb2283e-e174-479a-96fe-a7d5004c3b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f', 'volume_size': 1}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-830780035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb2283e-e174-479a-96fe-a7d5004c3b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba603302918488bbabb4de05dc9e4ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:52Z,use_quota=True,user_id='07e5899824514a4e9600306a1451fe5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Creating volume 0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:52 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:52 devstack sudo[96864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f 1073741824
Jun 15 04:18:52 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:53 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f 1073741824" returned: 0 in 1.042s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:53 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f
Jun 15 04:18:53 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:53 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f" returned: 0 in 0.656s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0e5b55-b4c7-4e3e-af29-ba02ad1d9fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20e4831-5131-45b0-93b2-2e613dea7f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:53 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Volume volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f (0bb2283e-e174-479a-96fe-a7d5004c3b2f): created successfully
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20e4831-5131-45b0-93b2-2e613dea7f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Flow 'volume_create_manager' (b6282121-8daa-4016-bd7f-7130aa1c5c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-d860a20e-054f-496d-a8c4-ef67d9900c23 req-00cbf187-06ff-4588-a11e-a5eefd8991c5 tempest-VolumesSnapshotsTestJSON-158198259 None] Created volume successfully.
Jun 15 04:18:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Creating offline snapshot 75325b6a-55a5-4a0d-9f06-decc1e3831c5 of volume 0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:18:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee62c6e-c921-49bd-9758-50140f671b2d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:54 devstack sudo[96910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f
Jun 15 04:18:54 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:55 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f" returned: 0 in 0.999s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:55 devstack sudo[96916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 1G
Jun 15 04:18:55 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Flow 'volume_create_manager' (1ba95949-15a5-4c4e-9ff8-a910ebc857dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c805b77-fadb-4668-a0e8-b265fadd1bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c805b77-fadb-4668-a0e8-b265fadd1bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526242257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2798ab94-72de-4305-b10a-efc661cf0a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae83f7e74c284fecaf26b0f8c494b420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:56Z,use_quota=True,user_id='9c3e3e37080f4eb4b48470801abb5a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff8bd99-35b5-476d-a98e-30d4a2d6b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff8bd99-35b5-476d-a98e-30d4a2d6b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3f256f-34e3-4e2c-ab6b-9a9b805336c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3f256f-34e3-4e2c-ab6b-9a9b805336c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2798ab94-72de-4305-b10a-efc661cf0a2a', 'volume_name': 'volume-2798ab94-72de-4305-b10a-efc661cf0a2a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513f3334-afff-4f90-b769-4d0c4663421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513f3334-afff-4f90-b769-4d0c4663421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca9a662-5fcb-484d-b18a-faffbc2eb91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:18:56 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Volume 2798ab94-72de-4305-b10a-efc661cf0a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2798ab94-72de-4305-b10a-efc661cf0a2a', 'volume_size': 1}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:56 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 1G" returned: 0 in 0.886s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:56 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5
Jun 15 04:18:56 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:57 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5" returned: 0 in 0.672s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:57 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 is being set with open permissions: ugo+rw
Jun 15 04:18:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:57 devstack sudo[96929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5
Jun 15 04:18:57 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:57 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5" returned: 0 in 0.587s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:57 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info
Jun 15 04:18:57 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:58 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info" returned: 0 in 0.591s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:58 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info is being set with open permissions: ugo+rw
Jun 15 04:18:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:58 devstack sudo[96935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info
Jun 15 04:18:58 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:58 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.info" returned: 0 in 0.577s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.425s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.703s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526242257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2798ab94-72de-4305-b10a-efc661cf0a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae83f7e74c284fecaf26b0f8c494b420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:18:56Z,use_quota=True,user_id='9c3e3e37080f4eb4b48470801abb5a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Creating volume 2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:18:59 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:59 devstack sudo[96938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a 1073741824
Jun 15 04:18:59 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:59 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-0564857f-6b3a-47f3-b696-f124bf585055 req-efa63058-1db4-447e-be89-73319ca3c46b tempest-VolumesSnapshotsTestJSON-158198259 None] Create snapshot completed successfully
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "cinder-75325b6a-55a5-4a0d-9f06-decc1e3831c5-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-75325b6a-55a5-4a0d-9f06-decc1e3831c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "cinder-quobyte-0bb2283e-e174-479a-96fe-a7d5004c3b2f" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-quobyte-0bb2283e-e174-479a-96fe-a7d5004c3b2f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "cinder-quobyte-75325b6a-55a5-4a0d-9f06-decc1e3831c5" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-quobyte-75325b6a-55a5-4a0d-9f06-decc1e3831c5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Deleting offline snapshot 75325b6a-55a5-4a0d-9f06-decc1e3831c5 of volume 0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] snapshot_file for this snap is: volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f54a149-9e65-42a1-9068-d3e699a7d068]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:59 devstack sudo[96940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5
Jun 15 04:18:59 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:18:59 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a 1073741824" returned: 0 in 0.777s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:18:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:18:59 devstack sudo[96947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:18:59 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:00 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5" returned: 0 in 0.802s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e508c5f-d26a-457e-9233-b47d8a2966b7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:00 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f
Jun 15 04:19:00 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:00 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 0.667s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca9a662-5fcb-484d-b18a-faffbc2eb91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2798ab94-72de-4305-b10a-efc661cf0a2a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54a1e39-f6e1-492e-84fb-9d13921faffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Volume volume-2798ab94-72de-4305-b10a-efc661cf0a2a (2798ab94-72de-4305-b10a-efc661cf0a2a): created successfully
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54a1e39-f6e1-492e-84fb-9d13921faffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Flow 'volume_create_manager' (1ba95949-15a5-4c4e-9ff8-a910ebc857dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-336061ee-b6d5-470f-ba04-69138f210726 tempest-VolumesActionsTest-247209360 None] Created volume successfully.
Jun 15 04:19:00 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f" returned: 0 in 0.777s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:00 devstack sudo[96958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5
Jun 15 04:19:00 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:01 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5" returned: 0 in 0.763s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:01 devstack sudo[96965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5
Jun 15 04:19:01 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:02 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f.75325b6a-55a5-4a0d-9f06-decc1e3831c5" returned: 0 in 0.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-quobyte-75325b6a-55a5-4a0d-9f06-decc1e3831c5" released by "_delete_snapshot" :: held 3.194s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-quobyte-0bb2283e-e174-479a-96fe-a7d5004c3b2f" released by "delete_snapshot" :: held 3.229s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:02 devstack cinder-volume[92103]: DEBUG cinder.quota [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Created reservations ['a801c181-defa-4a49-963a-e41e29af2633', '311b8ca5-89b3-4ef1-9f45-0f9188be3c9e', '87d18b32-1081-4388-95c8-880115b65874', '461e5d8b-6daf-47a4-98f6-a18e8237e214'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Delete snapshot completed successfully.
Jun 15 04:19:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-12685feb-417e-4e6b-ade3-424d434a8ccf req-fcd01ae7-d574-4099-af85-a37c62ed3337 tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-75325b6a-55a5-4a0d-9f06-decc1e3831c5-delete_snapshot" released by "delete_snapshot" :: held 3.406s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "cinder-0bb2283e-e174-479a-96fe-a7d5004c3b2f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-0bb2283e-e174-479a-96fe-a7d5004c3b2f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "cinder-quobyte-0bb2283e-e174-479a-96fe-a7d5004c3b2f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-quobyte-0bb2283e-e174-479a-96fe-a7d5004c3b2f" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0509b6c5-1f9f-48df-a4b5-4ac11b839068]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:03 devstack sudo[96972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f
Jun 15 04:19:03 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:04 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f" returned: 0 in 0.789s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:04 devstack sudo[96978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f
Jun 15 04:19:04 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:05 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bb2283e-e174-479a-96fe-a7d5004c3b2f" returned: 0 in 0.718s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-quobyte-0bb2283e-e174-479a-96fe-a7d5004c3b2f" released by "delete_volume" :: held 1.602s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG cinder.quota [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Created reservations ['e9c584ad-dd7a-4e42-9e71-d9e9d06e90d9', '126fce71-b9dc-4b40-87ec-f635416b40bd', 'bbbf7c7d-8e89-4b44-9bd5-526fc2cc8d96', '114b7b8b-2c6c-4fdf-a92d-6dda5583f3d3'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:05 devstack sudo[96982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:05 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:06 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:06 devstack cinder-volume[92103]: DEBUG cinder.manager [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Deleted volume successfully.
Jun 15 04:19:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-65297dcd-a975-4a01-9480-e6c852819342 req-dcef8d7b-5bd7-4f22-8a66-fc808a9c960e tempest-VolumesSnapshotsTestJSON-158198259 None] Lock "cinder-0bb2283e-e174-479a-96fe-a7d5004c3b2f-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Flow 'volume_create_manager' (e226f9ec-fa80-41b5-834c-0b20affc47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e504b4d8-e18a-4870-9722-326c76da3487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e504b4d8-e18a-4870-9722-326c76da3487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-923065416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810c9e13-94bd-4de5-b489-b77643d738d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e91081c817454500a0ea6d5ef91e18f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:11Z,use_quota=True,user_id='1916892b866d443a8bf58fc5ce069cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094b54f2-50b0-4042-84f7-7f9a10b86c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094b54f2-50b0-4042-84f7-7f9a10b86c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17c5217-8dfb-4359-997b-75e84d9fd940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17c5217-8dfb-4359-997b-75e84d9fd940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810c9e13-94bd-4de5-b489-b77643d738d0', 'volume_name': 'volume-810c9e13-94bd-4de5-b489-b77643d738d0', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587d17c0-2f05-4da7-9d51-14694f062d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587d17c0-2f05-4da7-9d51-14694f062d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5053f23-b5ed-4643-b726-782b9b8fdc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:11 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Volume 810c9e13-94bd-4de5-b489-b77643d738d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810c9e13-94bd-4de5-b489-b77643d738d0', 'volume_size': 1}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-923065416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810c9e13-94bd-4de5-b489-b77643d738d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e91081c817454500a0ea6d5ef91e18f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:11Z,use_quota=True,user_id='1916892b866d443a8bf58fc5ce069cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Creating volume 810c9e13-94bd-4de5-b489-b77643d738d0 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:19:11 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:19:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:11 devstack sudo[97006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0 1073741824
Jun 15 04:19:11 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:12 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0 1073741824" returned: 0 in 0.798s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:12 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0
Jun 15 04:19:12 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:12 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0" returned: 0 in 0.746s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5053f23-b5ed-4643-b726-782b9b8fdc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810c9e13-94bd-4de5-b489-b77643d738d0', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cb211a-26a6-4b3d-a643-9c2b2c794b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:12 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Volume volume-810c9e13-94bd-4de5-b489-b77643d738d0 (810c9e13-94bd-4de5-b489-b77643d738d0): created successfully
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cb211a-26a6-4b3d-a643-9c2b2c794b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Flow 'volume_create_manager' (e226f9ec-fa80-41b5-834c-0b20affc47e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:12 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-97ce3907-d74c-40dd-9740-f5b8d1a1e2d0 req-5a90b340-1de6-46f6-9608-15b7f0d5821a tempest-VolumesGetTestJSON-440976878 None] Created volume successfully.
Jun 15 04:19:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Acquiring lock "cinder-810c9e13-94bd-4de5-b489-b77643d738d0-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Lock "cinder-810c9e13-94bd-4de5-b489-b77643d738d0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Acquiring lock "cinder-quobyte-810c9e13-94bd-4de5-b489-b77643d738d0" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Lock "cinder-quobyte-810c9e13-94bd-4de5-b489-b77643d738d0" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907726c-89a2-48c4-9d4f-d37c56081406]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:13 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0
Jun 15 04:19:13 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:14 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0" returned: 0 in 0.796s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:14 devstack sudo[97027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0
Jun 15 04:19:14 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:15 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-810c9e13-94bd-4de5-b489-b77643d738d0" returned: 0 in 1.168s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Lock "cinder-quobyte-810c9e13-94bd-4de5-b489-b77643d738d0" released by "delete_volume" :: held 2.029s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:15 devstack cinder-volume[92103]: DEBUG cinder.quota [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Created reservations ['64ea8096-f609-48fc-918b-737d7094aab8', 'e7d953d4-411d-4a9b-a4c7-9b37c7cffc35', 'bbed858e-6c11-404f-8a4e-df67eb72924e', 'd67d05bf-f489-4b51-a9f3-b6c6744efada'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:16 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:16 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:17 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.327s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:17 devstack cinder-volume[92103]: DEBUG cinder.manager [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Deleted volume successfully.
Jun 15 04:19:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-899ff8ae-579f-4e3e-96a5-ddbf05b9394c req-74f05a8a-e57b-430f-beaa-979fb2fe861b tempest-VolumesGetTestJSON-440976878 None] Lock "cinder-810c9e13-94bd-4de5-b489-b77643d738d0-delete_volume" released by "delete_volume" :: held 3.716s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3d62668-bd9f-47b0-8c08-2f226ad856c8 tempest-VolumesActionsTest-247209360 None] Acquiring lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a" by "attach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3d62668-bd9f-47b0-8c08-2f226ad856c8 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a" acquired by "attach_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a3d62668-bd9f-47b0-8c08-2f226ad856c8 tempest-VolumesActionsTest-247209360 None] Attaching volume 2798ab94-72de-4305-b10a-efc661cf0a2a to instance 6e540e01-8c21-40b9-ad73-d4a0c86e2451 at mountpoint /dev/vdb on host None.
Jun 15 04:19:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a3d62668-bd9f-47b0-8c08-2f226ad856c8 tempest-VolumesActionsTest-247209360 None] Attach volume completed successfully.
Jun 15 04:19:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3d62668-bd9f-47b0-8c08-2f226ad856c8 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a" released by "attach_volume" :: held 0.128s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-92d206e9-c5dc-4960-a1c2-0b5b4cd6816c tempest-VolumesActionsTest-247209360 None] Acquiring lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-detach_volume" by "detach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-92d206e9-c5dc-4960-a1c2-0b5b4cd6816c tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-92d206e9-c5dc-4960-a1c2-0b5b4cd6816c tempest-VolumesActionsTest-247209360 None] Detaching volume 2798ab94-72de-4305-b10a-efc661cf0a2a from instance 6e540e01-8c21-40b9-ad73-d4a0c86e2451.
Jun 15 04:19:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-92d206e9-c5dc-4960-a1c2-0b5b4cd6816c tempest-VolumesActionsTest-247209360 None] Detach volume completed successfully.
Jun 15 04:19:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-92d206e9-c5dc-4960-a1c2-0b5b4cd6816c tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Flow 'volume_create_manager' (a10a478f-ef36-40f9-847a-c4ed03caf513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdfabbcb-0904-4771-8c2a-94e2e360771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdfabbcb-0904-4771-8c2a-94e2e360771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-388312510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9d7ed5-9bad-4af2-b030-8d065e261cc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab89dfad84428cbc46da6b098766a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:23Z,use_quota=True,user_id='d59ba6fecf314bdba81da003a0e855b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50820e8f-f474-4914-8b00-24c8687c5243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50820e8f-f474-4914-8b00-24c8687c5243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e1f51e-8b53-4888-8d00-93c5af91454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e1f51e-8b53-4888-8d00-93c5af91454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9d7ed5-9bad-4af2-b030-8d065e261cc0', 'volume_name': 'volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489686c6-f3ee-4f79-b90c-5d6cfc7213ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489686c6-f3ee-4f79-b90c-5d6cfc7213ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1afeec-be18-4993-945c-d3cd5e040991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:22 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Volume ac9d7ed5-9bad-4af2-b030-8d065e261cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0', 'volume_size': 1}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-388312510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9d7ed5-9bad-4af2-b030-8d065e261cc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab89dfad84428cbc46da6b098766a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:23Z,use_quota=True,user_id='d59ba6fecf314bdba81da003a0e855b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Creating volume ac9d7ed5-9bad-4af2-b030-8d065e261cc0 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:19:22 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:19:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:22 devstack sudo[97227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 1073741824
Jun 15 04:19:22 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:23 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 1073741824" returned: 0 in 0.794s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:23 devstack sudo[97235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0
Jun 15 04:19:23 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:24 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0" returned: 0 in 0.692s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1afeec-be18-4993-945c-d3cd5e040991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f32db7-7503-42bf-88bd-96880ead8a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:24 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Volume volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 (ac9d7ed5-9bad-4af2-b030-8d065e261cc0): created successfully
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f32db7-7503-42bf-88bd-96880ead8a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Flow 'volume_create_manager' (a10a478f-ef36-40f9-847a-c4ed03caf513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9d453a8e-4750-42a7-b9fd-d150ca65d4ea tempest-VolumesTestJSON-315155428 None] Created volume successfully.
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Flow 'volume_create_manager' (c893f632-51dd-4e66-bf3f-8709b134f9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c54f1a-2982-4b43-b12a-6641e05092a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c54f1a-2982-4b43-b12a-6641e05092a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533715800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea65ad-f497-4a64-897f-61a801e300c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab89dfad84428cbc46da6b098766a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:25Z,use_quota=True,user_id='d59ba6fecf314bdba81da003a0e855b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36354e8f-e6e1-41a1-876b-ff5f02754c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36354e8f-e6e1-41a1-876b-ff5f02754c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9b67e-b666-4c06-a128-ec625fcfb797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9b67e-b666-4c06-a128-ec625fcfb797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ea65ad-f497-4a64-897f-61a801e300c1', 'volume_name': 'volume-c0ea65ad-f497-4a64-897f-61a801e300c1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6acca7-0976-446d-85b0-864231f15dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6acca7-0976-446d-85b0-864231f15dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1374c7e4-6bfa-44ae-86de-458ec4ef9bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:25 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Volume c0ea65ad-f497-4a64-897f-61a801e300c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ea65ad-f497-4a64-897f-61a801e300c1', 'volume_size': 1}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-533715800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea65ad-f497-4a64-897f-61a801e300c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab89dfad84428cbc46da6b098766a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:25Z,use_quota=True,user_id='d59ba6fecf314bdba81da003a0e855b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Creating volume c0ea65ad-f497-4a64-897f-61a801e300c1 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:19:25 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:19:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:25 devstack sudo[97245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1 1073741824
Jun 15 04:19:25 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:26 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1 1073741824" returned: 0 in 1.028s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:26 devstack sudo[97255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1
Jun 15 04:19:26 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:27 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1" returned: 0 in 0.669s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1374c7e4-6bfa-44ae-86de-458ec4ef9bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ea65ad-f497-4a64-897f-61a801e300c1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecb66c6-715e-407b-9e13-280c2cca14d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Volume volume-c0ea65ad-f497-4a64-897f-61a801e300c1 (c0ea65ad-f497-4a64-897f-61a801e300c1): created successfully
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecb66c6-715e-407b-9e13-280c2cca14d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Flow 'volume_create_manager' (c893f632-51dd-4e66-bf3f-8709b134f9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:27 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ad146b53-1ba8-425b-adef-c222805ff373 tempest-VolumesTestJSON-315155428 None] Created volume successfully.
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Flow 'volume_create_manager' (ad00e3f7-049c-4012-894b-fa94e18a8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f140ccc8-90f7-4c15-a5ea-278c4ed3fb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f140ccc8-90f7-4c15-a5ea-278c4ed3fb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2041858320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01f94f2-4732-443b-824f-f6e52fd08b70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab89dfad84428cbc46da6b098766a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:28Z,use_quota=True,user_id='d59ba6fecf314bdba81da003a0e855b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0519addf-662d-4c0b-a7e4-c66a04beda22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0519addf-662d-4c0b-a7e4-c66a04beda22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f48e70-e0f2-449f-be88-15203f567bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f48e70-e0f2-449f-be88-15203f567bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01f94f2-4732-443b-824f-f6e52fd08b70', 'volume_name': 'volume-a01f94f2-4732-443b-824f-f6e52fd08b70', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff14e97-485d-4239-870e-2f5223eff923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff14e97-485d-4239-870e-2f5223eff923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68f9683-6a35-4c0b-8d47-83b7244408e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:28 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Volume a01f94f2-4732-443b-824f-f6e52fd08b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01f94f2-4732-443b-824f-f6e52fd08b70', 'volume_size': 1}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2041858320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01f94f2-4732-443b-824f-f6e52fd08b70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab89dfad84428cbc46da6b098766a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:19:28Z,use_quota=True,user_id='d59ba6fecf314bdba81da003a0e855b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Creating volume a01f94f2-4732-443b-824f-f6e52fd08b70 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:19:28 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:28 devstack sudo[97275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70 1073741824
Jun 15 04:19:28 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:28 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70 1073741824" returned: 0 in 0.837s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:29 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70
Jun 15 04:19:29 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Acquiring lock "cinder-746e6721-f78d-4b33-a2eb-3c6a28365ca3-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Lock "cinder-746e6721-f78d-4b33-a2eb-3c6a28365ca3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Acquiring lock "cinder-quobyte-746e6721-f78d-4b33-a2eb-3c6a28365ca3" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Lock "cinder-quobyte-746e6721-f78d-4b33-a2eb-3c6a28365ca3" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f2f36-19dc-4cab-8892-44845ae3d23a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:29 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3
Jun 15 04:19:29 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:30 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70" returned: 0 in 0.987s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68f9683-6a35-4c0b-8d47-83b7244408e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01f94f2-4732-443b-824f-f6e52fd08b70', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fcbc8b-8257-4cf7-ad79-f658304a8792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:19:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Volume volume-a01f94f2-4732-443b-824f-f6e52fd08b70 (a01f94f2-4732-443b-824f-f6e52fd08b70): created successfully
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fcbc8b-8257-4cf7-ad79-f658304a8792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Flow 'volume_create_manager' (ad00e3f7-049c-4012-894b-fa94e18a8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:19:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-27c09c83-194b-41cd-b864-ae4fdb6b294a tempest-VolumesTestJSON-315155428 None] Created volume successfully.
Jun 15 04:19:30 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3" returned: 0 in 0.832s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:30 devstack sudo[97295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3
Jun 15 04:19:30 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Acquiring lock "cinder-a01f94f2-4732-443b-824f-f6e52fd08b70-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Lock "cinder-a01f94f2-4732-443b-824f-f6e52fd08b70-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Acquiring lock "cinder-quobyte-a01f94f2-4732-443b-824f-f6e52fd08b70" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Lock "cinder-quobyte-a01f94f2-4732-443b-824f-f6e52fd08b70" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:31 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-746e6721-f78d-4b33-a2eb-3c6a28365ca3" returned: 0 in 0.666s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4bba73-f87c-4b34-be5b-377e92b105e6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Lock "cinder-quobyte-746e6721-f78d-4b33-a2eb-3c6a28365ca3" released by "delete_volume" :: held 1.549s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Created reservations ['a635088e-3b3c-482f-ac61-443950d8d3e6', '8c0c2bf3-d0fd-488c-9cf2-9aabcac1d141', '45ec9252-d748-4671-9cc7-d9bbd3542df9', 'aa36e570-c82d-41c9-bb46-15fb6f863f32'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:31 devstack sudo[97302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70
Jun 15 04:19:31 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:31 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:31 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:31 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:32 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.637s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:32 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:32 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70
Jun 15 04:19:32 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Deleted volume successfully.
Jun 15 04:19:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-591abb1d-d35b-4984-98ae-98874a7b9e79 tempest-TaggedAttachmentsTest-90829218 None] Lock "cinder-746e6721-f78d-4b33-a2eb-3c6a28365ca3-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:33 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a01f94f2-4732-443b-824f-f6e52fd08b70" returned: 0 in 1.167s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Lock "cinder-quobyte-a01f94f2-4732-443b-824f-f6e52fd08b70" released by "delete_volume" :: held 2.013s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Created reservations ['d2054cd3-cb66-47b8-837e-8d3fb3ea0fa6', 'a461e06b-6bc4-4d13-aecb-05b056611574', 'aaae92b4-7981-4071-b395-00ce2f7db6e2', '296f235e-4dec-4cce-8216-9b727c28ac77'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:33 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:33 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:34 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.922s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:34 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Deleted volume successfully.
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f80d9031-658d-4b84-81e0-dd2a70a873f3 tempest-VolumesTestJSON-315155428 None] Lock "cinder-a01f94f2-4732-443b-824f-f6e52fd08b70-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Acquiring lock "cinder-c0ea65ad-f497-4a64-897f-61a801e300c1-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Lock "cinder-c0ea65ad-f497-4a64-897f-61a801e300c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:INSERT=24,cinder:UPDATE=107,cinder:SELECT=91,cinder:DELETE=10 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Acquiring lock "cinder-quobyte-c0ea65ad-f497-4a64-897f-61a801e300c1" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Lock "cinder-quobyte-c0ea65ad-f497-4a64-897f-61a801e300c1" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e3b277-a54a-4bef-b2c7-57bd6f4acfb3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:34 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1
Jun 15 04:19:34 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:35 devstack sudo[97419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:35 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:36 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1" returned: 0 in 1.537s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:36 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1
Jun 15 04:19:36 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:36 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.522s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:19:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:19:37 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c0ea65ad-f497-4a64-897f-61a801e300c1" returned: 0 in 1.173s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Lock "cinder-quobyte-c0ea65ad-f497-4a64-897f-61a801e300c1" released by "delete_volume" :: held 2.789s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=66,cinder:UPDATE=105,cinder:INSERT=28,cinder:DELETE=7 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Created reservations ['ff831f3f-7f2c-4f71-8bad-12dbe01bd6f8', 'c6ba54e9-eb0a-4e8a-898a-aae5297ac489', '71c663d6-d156-42e0-b9bd-847019487666', 'e65b39ae-fb13-4356-974b-cf772f4b8902'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:37 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:37 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Acquiring lock "cinder-ac9d7ed5-9bad-4af2-b030-8d065e261cc0-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Lock "cinder-ac9d7ed5-9bad-4af2-b030-8d065e261cc0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Acquiring lock "cinder-quobyte-ac9d7ed5-9bad-4af2-b030-8d065e261cc0" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Lock "cinder-quobyte-ac9d7ed5-9bad-4af2-b030-8d065e261cc0" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1383aad-9e54-40e7-a676-97246767643e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:38 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0
Jun 15 04:19:38 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:38 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.380s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:39 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:39 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Deleted volume successfully.
Jun 15 04:19:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb48ace-70f6-4a02-8413-2e35a9f6e7ec tempest-VolumesTestJSON-315155428 None] Lock "cinder-c0ea65ad-f497-4a64-897f-61a801e300c1-delete_volume" released by "delete_volume" :: held 4.504s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:39 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0" returned: 0 in 1.295s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:39 devstack sudo[97453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0
Jun 15 04:19:39 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:40 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ac9d7ed5-9bad-4af2-b030-8d065e261cc0" returned: 0 in 0.958s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Lock "cinder-quobyte-ac9d7ed5-9bad-4af2-b030-8d065e261cc0" released by "delete_volume" :: held 2.321s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Created reservations ['fad9df94-a87c-46b7-ba58-5ece82796f69', 'd70d150d-51dc-4049-8bf3-72a1a76f1397', '97bcc3c9-4c0c-4360-926e-8212e211aec1', '9ab03080-8f9b-4912-b172-87f7458bdb4d'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:19:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:19:40 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:19:40 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:19:41 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Jun 15 04:19:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.939s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:19:41 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:19:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Deleted volume successfully.
Jun 15 04:19:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3770c917-7b03-4ae3-a952-c1d5f1db915e tempest-VolumesTestJSON-315155428 None] Lock "cinder-ac9d7ed5-9bad-4af2-b030-8d065e261cc0-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6e58cf76-0cb4-4c7c-8f98-50e489e16c18 tempest-VolumesActionsTest-247209360 None] Acquiring lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a" by "attach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6e58cf76-0cb4-4c7c-8f98-50e489e16c18 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a" acquired by "attach_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6e58cf76-0cb4-4c7c-8f98-50e489e16c18 tempest-VolumesActionsTest-247209360 None] Attaching volume 2798ab94-72de-4305-b10a-efc661cf0a2a to instance 48af7966-9280-48b6-b46d-526cb5d5099f at mountpoint /dev/vdb on host None.
Jun 15 04:19:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6e58cf76-0cb4-4c7c-8f98-50e489e16c18 tempest-VolumesActionsTest-247209360 None] Attach volume completed successfully.
Jun 15 04:19:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6e58cf76-0cb4-4c7c-8f98-50e489e16c18 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a" released by "attach_volume" :: held 0.208s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-559118b6-5060-4b7f-aca5-4aa03a06ec06 tempest-VolumesActionsTest-247209360 None] Acquiring lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-detach_volume" by "detach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:19:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-559118b6-5060-4b7f-aca5-4aa03a06ec06 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:19:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-559118b6-5060-4b7f-aca5-4aa03a06ec06 tempest-VolumesActionsTest-247209360 None] Detaching volume 2798ab94-72de-4305-b10a-efc661cf0a2a from instance 48af7966-9280-48b6-b46d-526cb5d5099f.
Jun 15 04:19:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-559118b6-5060-4b7f-aca5-4aa03a06ec06 tempest-VolumesActionsTest-247209360 None] Detach volume completed successfully.
Jun 15 04:19:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-559118b6-5060-4b7f-aca5-4aa03a06ec06 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:19:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d8f44b51-1360-478a-b6a1-ec2d14fd6eb2 tempest-BackendsCapabilitiesAdminTestsJSON-1887114154 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92103) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 15 04:19:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5b48d9df-3645-4343-a07d-8c8a50bf0bbb tempest-BackendsCapabilitiesAdminTestsJSON-1887114154 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92103) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 15 04:20:00 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:20:00 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=17,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:20:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11021c-cc66-4b0e-af73-5784e5231bee]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:02 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:02 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:03 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 1.093s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[be14c3a9-4f6d-4f9e-a9b2-0ad72f4f6f54]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:04 devstack sudo[97674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:04 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:05 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 1.319s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.4e311f27-d350-4dad-a1d0-7103b262e210wikl2luu.img {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:05 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.4e311f27-d350-4dad-a1d0-7103b262e210wikl2luu.img
Jun 15 04:20:05 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-60ca9036-0b79-4c03-8431-d7aa13d7ae65 tempest-GroupsV314Test-685968950 None] Group tempest-GroupsV314Test-Group-2033499364: creating
Jun 15 04:20:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-60ca9036-0b79-4c03-8431-d7aa13d7ae65 tempest-GroupsV314Test-685968950 None] Group tempest-GroupsV314Test-Group-2033499364: created successfully
Jun 15 04:20:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-60ca9036-0b79-4c03-8431-d7aa13d7ae65 tempest-GroupsV314Test-685968950 None] Create group completed successfully.
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Flow 'volume_create_manager' (67252f61-5e88-4c6b-9703-045efbe5d374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9f8f9-34c1-4ba1-a5a5-4d38134c9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b9f8f9-34c1-4ba1-a5a5-4d38134c9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-655545119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c687db7-d6be-44df-8f6c-df79e4369254,host='devstack@QuobyteHD#QuobyteHD',id=c6945152-2a4f-4cae-a31d-c93b1f298fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142b1857378543399a40e811931ad524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:09Z,use_quota=True,user_id='5149d202aefd483eab332c9a585709b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfe4268f-1167-431b-ac2f-828618cc43ad),volume_type_id=bfe4268f-1167-431b-ac2f-828618cc43ad)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2912a6-5aac-45b6-bf75-dc45aa8996da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2912a6-5aac-45b6-bf75-dc45aa8996da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3d498d-3185-4f56-8cc0-235a00c56c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3d498d-3185-4f56-8cc0-235a00c56c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6945152-2a4f-4cae-a31d-c93b1f298fab', 'volume_name': 'volume-c6945152-2a4f-4cae-a31d-c93b1f298fab', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9851ac65-c879-407a-bd87-f45b8a5ee32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9851ac65-c879-407a-bd87-f45b8a5ee32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdeafcd-2980-47f8-8b3e-e7c79c920e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:09 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Volume c6945152-2a4f-4cae-a31d-c93b1f298fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6945152-2a4f-4cae-a31d-c93b1f298fab', 'volume_size': 1}
Jun 15 04:20:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:11 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.4e311f27-d350-4dad-a1d0-7103b262e210wikl2luu.img" returned: 0 in 6.521s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:11 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fc550-272e-4ba4-9b38-f1efda18e325]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:11 devstack sudo[97745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:11 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Flow 'volume_create_manager' (56522aee-c69c-4162-80aa-e9efdd172495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbb1f87-3922-4431-91e7-c42fe4a98787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbb1f87-3922-4431-91e7-c42fe4a98787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-343683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea8dac7-89cf-4d3a-8667-7933ba52ffd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e4e1d50944ebcb9ec66e9d74581d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:13Z,use_quota=True,user_id='a6026b3449bf47ca98c309fd53bcc660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290e4693-5fc2-4d4a-8164-aab057163e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290e4693-5fc2-4d4a-8164-aab057163e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0671795c-7fb1-41f1-bc2e-1f45b24a8c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0671795c-7fb1-41f1-bc2e-1f45b24a8c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea8dac7-89cf-4d3a-8667-7933ba52ffd6', 'volume_name': 'volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021f2003-18c4-42f2-a5f2-ed77ef742f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021f2003-18c4-42f2-a5f2-ed77ef742f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ea1296-2572-4467-b032-15a76ab2bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:12 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Volume 1ea8dac7-89cf-4d3a-8667-7933ba52ffd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6', 'volume_size': 1}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:12 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 0.914s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.4e311f27-d350-4dad-a1d0-7103b262e210wikl2luu.img {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:20:12 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Converted 1024.00 MB image at 157.00 MB/s
Jun 15 04:20:12 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] 4e311f27-d350-4dad-a1d0-7103b262e210 was raw, no need to convert to raw {{(pid=92103) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 15 04:20:22 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:20:22 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:35 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:20:35 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:36 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.900s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:20:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:20:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:20:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.178s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Uploaded volume to glance image-id: 4e311f27-d350-4dad-a1d0-7103b262e210. {{(pid=92103) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.646s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6c687db7-d6be-44df-8f6c-df79e4369254,created_at=2026-06-15T02:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-655545119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c687db7-d6be-44df-8f6c-df79e4369254,host='devstack@QuobyteHD#QuobyteHD',id=c6945152-2a4f-4cae-a31d-c93b1f298fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142b1857378543399a40e811931ad524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:09Z,use_quota=True,user_id='5149d202aefd483eab332c9a585709b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfe4268f-1167-431b-ac2f-828618cc43ad),volume_type_id=bfe4268f-1167-431b-ac2f-828618cc43ad)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Creating volume c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:20:37 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:20:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:37 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab 1073741824
Jun 15 04:20:37 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-826689b2-2fce-4aeb-bcbb-30b8913bd5fc tempest-VolumesActionsTest-247209360 None] Copy volume to image completed successfully.
Jun 15 04:20:38 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab 1073741824" returned: 0 in 0.904s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:38 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:20:38 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:39 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.931s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.164s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-343683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea8dac7-89cf-4d3a-8667-7933ba52ffd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e4e1d50944ebcb9ec66e9d74581d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:13Z,use_quota=True,user_id='a6026b3449bf47ca98c309fd53bcc660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Creating volume 1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:20:39 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:39 devstack sudo[98066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 1073741824
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdeafcd-2980-47f8-8b3e-e7c79c920e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6945152-2a4f-4cae-a31d-c93b1f298fab', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:39 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51feed7a-e4d9-45df-939d-97d125542faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:39 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Volume volume-c6945152-2a4f-4cae-a31d-c93b1f298fab (c6945152-2a4f-4cae-a31d-c93b1f298fab): created successfully
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51feed7a-e4d9-45df-939d-97d125542faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Flow 'volume_create_manager' (67252f61-5e88-4c6b-9703-045efbe5d374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:20:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-aa20117a-8842-4d7a-92c3-9bab3a2114b2 tempest-GroupsV314Test-685968950 None] Created volume successfully.
Jun 15 04:20:40 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 1073741824" returned: 0 in 1.097s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:41 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6
Jun 15 04:20:41 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:41 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6" returned: 0 in 0.708s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.419s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ea1296-2572-4467-b032-15a76ab2bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015c5c6b-8319-4f6f-95c9-93b6d0cdf8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[15847d8e-9951-4608-a78a-0c6e04087cff]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:41 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Volume volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 (1ea8dac7-89cf-4d3a-8667-7933ba52ffd6): created successfully
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015c5c6b-8319-4f6f-95c9-93b6d0cdf8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Flow 'volume_create_manager' (56522aee-c69c-4162-80aa-e9efdd172495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:20:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-51de980b-becd-42e7-b7b5-e6c8efc9066e tempest-ServersNegativeTestJSON-1932861891 None] Created volume successfully.
Jun 15 04:20:41 devstack sudo[98102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:41 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Flow 'volume_create_manager' (3002a61e-e52c-4328-8dd8-1fd736ce01d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11833ca-2be0-4fd0-9255-0adc7718264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11833ca-2be0-4fd0-9255-0adc7718264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1017052250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc3d27a-4a4d-48b2-a944-2ce51f0559a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414e78d4ea584118b356b6b8f3996b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:43Z,use_quota=True,user_id='a7d2437a755a42d282f05c3694292798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3979388-797a-46ae-b6c7-fde849e8162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3979388-797a-46ae-b6c7-fde849e8162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41716b64-aaef-4b23-b98a-941d5a8cd3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41716b64-aaef-4b23-b98a-941d5a8cd3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc3d27a-4a4d-48b2-a944-2ce51f0559a1', 'volume_name': 'volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbe81c1-83e0-4bb1-8f19-535f76b9f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbe81c1-83e0-4bb1-8f19-535f76b9f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889a31ed-260a-46a6-80c1-fcfca687a3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:42 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Volume 6dc3d27a-4a4d-48b2-a944-2ce51f0559a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1', 'volume_size': 1}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:42 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 1.070s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe39b4f0-0d2b-40be-a2ae-5921e0c8e856]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:42 devstack sudo[98108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:42 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:43 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 0.855s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:43 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img
Jun 15 04:20:43 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Flow 'volume_create_manager' (7232ba5f-2ba8-46b4-988f-591ba46c69c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2538ba2b-ee35-486e-9b19-048fcbd3b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2538ba2b-ee35-486e-9b19-048fcbd3b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-75509999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff02aa4-b8cd-44d8-b1ae-b52493868094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e4e1d50944ebcb9ec66e9d74581d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:44Z,use_quota=True,user_id='a6026b3449bf47ca98c309fd53bcc660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a0cc7b-011b-4269-bc49-9b74d1449f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a0cc7b-011b-4269-bc49-9b74d1449f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f3969-3583-482b-98a0-56abcd1ce132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60f3969-3583-482b-98a0-56abcd1ce132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff02aa4-b8cd-44d8-b1ae-b52493868094', 'volume_name': 'volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797cf3e4-64dd-4db4-a5a0-a8d7080575ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797cf3e4-64dd-4db4-a5a0-a8d7080575ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710b9a7b-fe8b-40e9-8e82-e44f92f5d2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:20:44 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Volume 0ff02aa4-b8cd-44d8-b1ae-b52493868094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094', 'volume_size': 1}
Jun 15 04:20:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:50 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img" returned: 0 in 6.695s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa3894-7531-4545-bf11-b030c7030782]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:50 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:50 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:51 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 0.889s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:51 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:20:51 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Converted 1024.00 MB image at 152.93 MB/s
Jun 15 04:20:51 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] 6cc30089-5e74-4e3f-8d3b-43a88d282286 was raw, converting to qcow2 {{(pid=92103) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 15 04:20:51 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ba1f4-25b3-4784-923e-e59b28ed5171]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:51 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img
Jun 15 04:20:51 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:52 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img" returned: 0 in 0.680s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:52 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img
Jun 15 04:20:52 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:52 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img" returned: 1 in 0.708s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:20:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:52 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa
Jun 15 04:20:52 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:53 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa" returned: 0 in 0.670s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:53 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Image conversion details: src /opt/stack/data/cinder/conversion/2798ab94-72de-4305-b10a-efc661cf0a2a.temp_image.6cc30089-5e74-4e3f-8d3b-43a88d282286otrkpsc4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:20:53 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 15 04:20:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c86684-c3fc-4897-a3e3-0c537b2628b7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:53 devstack sudo[98162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa
Jun 15 04:20:53 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:54 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ni57vnqa" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.643s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Uploaded volume to glance image-id: 6cc30089-5e74-4e3f-8d3b-43a88d282286. {{(pid=92103) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 15 04:20:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.935s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:55 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Cloning volume c6945152-2a4f-4cae-a31d-c93b1f298fab to volume 89fed577-716f-4918-b60c-8647a815ec2e
Jun 15 04:20:55 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-742dfe8f-2b40-4f03-bd17-0804dc2c7a27 tempest-VolumesActionsTest-247209360 None] Copy volume to image completed successfully.
Jun 15 04:20:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Creating offline snapshot 3a0397ee-2928-4b15-9ee5-c19615a01966 of volume c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:20:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e9db2-2c81-4f14-acf6-3849520a2f14]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:55 devstack sudo[98168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:20:55 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:56 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.696s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:56 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 1G
Jun 15 04:20:56 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:56 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 1G" returned: 0 in 0.785s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6945152-2a4f-4cae-a31d-c93b1f298fab -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:56 devstack sudo[98193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6945152-2a4f-4cae-a31d-c93b1f298fab -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966
Jun 15 04:20:56 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Acquiring lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Acquiring lock "cinder-quobyte-2798ab94-72de-4305-b10a-efc661cf0a2a" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Lock "cinder-quobyte-2798ab94-72de-4305-b10a-efc661cf0a2a" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[08574483-1ea6-41a3-91ee-4fcb1a3a6654]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:57 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:57 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:57 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6945152-2a4f-4cae-a31d-c93b1f298fab -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966" returned: 0 in 0.697s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:57 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:57 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966
Jun 15 04:20:57 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:57 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 0.751s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:57 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a
Jun 15 04:20:57 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:58 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966" returned: 0 in 0.644s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:58 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info
Jun 15 04:20:58 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:58 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2798ab94-72de-4305-b10a-efc661cf0a2a" returned: 0 in 0.650s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Lock "cinder-quobyte-2798ab94-72de-4305-b10a-efc661cf0a2a" released by "delete_volume" :: held 1.450s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Created reservations ['d434f67f-7d4d-4d4d-856c-30b3926eed3e', 'e514bf38-5a0f-44e5-ac3c-a96d3272e682', 'd0e84b06-d908-4387-890a-ec07526fe6ea', '77946a63-2892-4d02-aa0b-96fc93cdb31d'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:58 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:20:58 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:58 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info" returned: 0 in 0.630s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:58 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:20:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:58 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info
Jun 15 04:20:58 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:20:59 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.670s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:20:59 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Deleted volume successfully.
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b6f4faa8-1fdf-4bd6-b1ae-0b673e684ea8 tempest-VolumesActionsTest-247209360 None] Lock "cinder-2798ab94-72de-4305-b10a-efc661cf0a2a-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:20:59 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.info" returned: 0 in 0.645s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Acquiring lock "cinder-quobyte-89fed577-716f-4918-b60c-8647a815ec2e" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-89fed577-716f-4918-b60c-8647a815ec2e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] snapshot: 3a0397ee-2928-4b15-9ee5-c19615a01966, volume: 89fed577-716f-4918-b60c-8647a815ec2e,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19df04-bdc5-4057-87c1-8cadd26425e3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:20:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:20:59 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966
Jun 15 04:20:59 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:00 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966" returned: 0 in 0.787s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6945152-2a4f-4cae-a31d-c93b1f298fab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:21:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:21:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:21:00 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[93af4d6c-b3fe-4296-837d-23220868446b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:00 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:21:00 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:01 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.817s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:01 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:21:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:01 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e
Jun 15 04:21:01 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:07 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e" returned: 0 in 5.947s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:07 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f0035-142c-4256-ab03-78f95b23de71]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:07 devstack sudo[98258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:21:07 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:08 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.929s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:21:08 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Converted 1024.00 MB image at 172.16 MB/s
Jun 15 04:21:08 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:08 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e
Jun 15 04:21:08 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Flow 'volume_create_manager' (0417b1e0-cfec-4950-bb37-7c2350aa4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3db545-2736-4861-b79c-2b478e1b8938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3db545-2736-4861-b79c-2b478e1b8938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1701041579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbf2093-7f26-4112-9eda-379f2b10fdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066181a1b95244b3a8606ee98e41913e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:08Z,use_quota=True,user_id='448294e7cad540e39b555d963c453481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bb3db8-d98d-4d4c-8e65-e029bb901e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bb3db8-d98d-4d4c-8e65-e029bb901e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88d9443-b372-4240-9701-0190202c9c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88d9443-b372-4240-9701-0190202c9c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'volume_name': 'volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f91aa7-4d39-4425-8d0a-e2130346fa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f91aa7-4d39-4425-8d0a-e2130346fa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4cc95e-c683-4c27-89b7-682ca833561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Volume 2fbf2093-7f26-4112-9eda-379f2b10fdbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'volume_size': 1}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:08 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e" returned: 0 in 0.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-89fed577-716f-4918-b60c-8647a815ec2e" released by "_copy_volume_from_snapshot" :: held 9.191s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Acquiring lock "cinder-quobyte-3a0397ee-2928-4b15-9ee5-c19615a01966" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-3a0397ee-2928-4b15-9ee5-c19615a01966" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Deleting offline snapshot 3a0397ee-2928-4b15-9ee5-c19615a01966 of volume c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] snapshot_file for this snap is: volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e8e5a9-9296-4e30-8492-7fc3f0f693a1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:08 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966
Jun 15 04:21:08 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:09 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966" returned: 0 in 0.715s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6945152-2a4f-4cae-a31d-c93b1f298fab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:21:09 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3320be4-8659-4b48-958e-ed52329aaab3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:09 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:21:09 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:10 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:10 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966
Jun 15 04:21:10 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:11 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966" returned: 0 in 0.677s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:11 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966
Jun 15 04:21:11 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:11 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab.3a0397ee-2928-4b15-9ee5-c19615a01966" returned: 0 in 0.593s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-3a0397ee-2928-4b15-9ee5-c19615a01966" released by "_delete_snapshot" :: held 2.800s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.305s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.895s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1017052250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc3d27a-4a4d-48b2-a944-2ce51f0559a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414e78d4ea584118b356b6b8f3996b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:43Z,use_quota=True,user_id='a7d2437a755a42d282f05c3694292798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Creating volume 6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:11 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:11 devstack sudo[98285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 1073741824
Jun 15 04:21:11 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-eea4158f-7e8f-48b6-88e3-0b679fab545d tempest-GroupsV314Test-685968950 None] Create group from source-group-6c687db7-d6be-44df-8f6c-df79e4369254 completed successfully.
Jun 15 04:21:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Acquiring lock "cinder-quobyte-89fed577-716f-4918-b60c-8647a815ec2e" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-89fed577-716f-4918-b60c-8647a815ec2e" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec72e15-c366-45fa-83a2-f82f9716f2a6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:12 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 1073741824" returned: 0 in 0.857s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:12 devstack sudo[98290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e
Jun 15 04:21:12 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:12 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1
Jun 15 04:21:12 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:13 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1" returned: 0 in 0.604s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.955s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-75509999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff02aa4-b8cd-44d8-b1ae-b52493868094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e4e1d50944ebcb9ec66e9d74581d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:20:44Z,use_quota=True,user_id='a6026b3449bf47ca98c309fd53bcc660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Creating volume 0ff02aa4-b8cd-44d8-b1ae-b52493868094 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:13 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:13 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e" returned: 0 in 0.742s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:13 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 1073741824
Jun 15 04:21:13 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889a31ed-260a-46a6-80c1-fcfca687a3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:13 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e
Jun 15 04:21:13 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf3879-6f0c-422b-b3db-12d21c898121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:13 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Volume volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 (6dc3d27a-4a4d-48b2-a944-2ce51f0559a1): created successfully
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf3879-6f0c-422b-b3db-12d21c898121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Flow 'volume_create_manager' (3002a61e-e52c-4328-8dd8-1fd736ce01d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5876a405-0e09-4e93-9727-5fe8d5318680 tempest-ServerRescueNegativeTestJSON-1035306237 None] Created volume successfully.
Jun 15 04:21:13 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-89fed577-716f-4918-b60c-8647a815ec2e" returned: 0 in 0.684s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-89fed577-716f-4918-b60c-8647a815ec2e" released by "delete_volume" :: held 1.475s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:13 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Created reservations ['481579b2-f022-4c70-98f2-9c21a12c29f4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:13 devstack cinder-volume[92103]: WARNING cinder.quota [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-32864473 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-32864473, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:21:13 devstack cinder-volume[92103]: WARNING cinder.quota [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-32864473 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-32864473, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Created reservations ['300b249a-f9d5-4b06-bad1-e7f7186eec70', '0d301e78-346c-4103-bfaa-a104ad4f0f9d', 'e76630f7-b6a1-400a-9fb2-fac5726cd3fb', '07a0ae09-f79d-4336-802f-a196ae9e5e78'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:14 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 1073741824" returned: 0 in 0.835s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:14 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094
Jun 15 04:21:14 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:14 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:14 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:14 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094" returned: 0 in 0.629s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.376s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1701041579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbf2093-7f26-4112-9eda-379f2b10fdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066181a1b95244b3a8606ee98e41913e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:08Z,use_quota=True,user_id='448294e7cad540e39b555d963c453481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Creating volume 2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:14 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710b9a7b-fe8b-40e9-8e82-e44f92f5d2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:14 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf 1073741824
Jun 15 04:21:14 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba259d7-51ec-4841-82ff-3a415c6789cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:14 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.651s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:14 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Volume volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 (0ff02aa4-b8cd-44d8-b1ae-b52493868094): created successfully
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba259d7-51ec-4841-82ff-3a415c6789cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Flow 'volume_create_manager' (7232ba5f-2ba8-46b4-988f-591ba46c69c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5b9489e4-4055-464a-9ac2-c858dcde6477 tempest-GroupsV314Test-685968950 None] Delete group completed successfully.
Jun 15 04:21:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-df2a0f25-8104-4ea9-a49b-9282bbec5456 tempest-ServersNegativeTestJSON-1932861891 None] Created volume successfully.
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Acquiring lock "cinder-quobyte-c6945152-2a4f-4cae-a31d-c93b1f298fab" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-c6945152-2a4f-4cae-a31d-c93b1f298fab" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755bf03-9cc3-4a97-8ce8-0f926c1c16d1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:15 devstack sudo[98315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:21:15 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:15 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf 1073741824" returned: 0 in 0.925s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:15 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:15 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "cinder-0ff02aa4-b8cd-44d8-b1ae-b52493868094-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-0ff02aa4-b8cd-44d8-b1ae-b52493868094-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:15 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.870s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "cinder-quobyte-0ff02aa4-b8cd-44d8-b1ae-b52493868094" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:15 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab
Jun 15 04:21:15 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-quobyte-0ff02aa4-b8cd-44d8-b1ae-b52493868094" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6187b74c-8d8a-4714-99b6-e659574d38b4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:16 devstack sudo[98328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094
Jun 15 04:21:16 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:16 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 0.680s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4cc95e-c683-4c27-89b7-682ca833561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56364ab1-0f87-4ec8-8466-afcc3cf6c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:16 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Volume volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf (2fbf2093-7f26-4112-9eda-379f2b10fdbf): created successfully
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56364ab1-0f87-4ec8-8466-afcc3cf6c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Flow 'volume_create_manager' (0417b1e0-cfec-4950-bb37-7c2350aa4f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6ec9575a-2383-4d2b-85e3-8b432736190e tempest-VolumesCloneTest-1566071448 None] Created volume successfully.
Jun 15 04:21:16 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c6945152-2a4f-4cae-a31d-c93b1f298fab" returned: 0 in 0.668s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Lock "cinder-quobyte-c6945152-2a4f-4cae-a31d-c93b1f298fab" released by "delete_volume" :: held 1.632s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Created reservations ['c5a61999-e2e4-4183-ac2a-4086c1dbf598'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Created reservations ['0a47f12a-af15-45b0-993b-c4872d3913a5', '70102101-f0d6-4ade-8f26-dadd2bee5f09', '9e0388b8-e95a-4357-9449-f8636828989a', '5f1d518c-fd79-409d-9aa3-db7f49155c4c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:16 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094" returned: 0 in 0.802s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:16 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094
Jun 15 04:21:16 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:16 devstack sudo[98337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:16 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Flow 'volume_create_manager' (20633bf9-1ca6-488a-9b4c-bccce4bb2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908ae05d-302b-4c78-a640-969315e06991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908ae05d-302b-4c78-a640-969315e06991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1764566070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4708541d-82c0-4be9-b8e4-90954c99f1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066181a1b95244b3a8606ee98e41913e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2fbf2093-7f26-4112-9eda-379f2b10fdbf,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:17Z,use_quota=True,user_id='448294e7cad540e39b555d963c453481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e921b7c2-9065-4e61-a12c-f769ff304438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e921b7c2-9065-4e61-a12c-f769ff304438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f823cb87-3d9a-414a-87b4-6d5b637b7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f823cb87-3d9a-414a-87b4-6d5b637b7652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4708541d-82c0-4be9-b8e4-90954c99f1a7', 'volume_name': 'volume-4708541d-82c0-4be9-b8e4-90954c99f1a7', 'volume_size': 2, 'source_volid': '2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'source_volstatus': 'available'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af69812a-125d-464b-86f4-f51f18a30db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af69812a-125d-464b-86f4-f51f18a30db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfac3e4-45a1-4758-9d3f-96d948df42e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Volume 4708541d-82c0-4be9-b8e4-90954c99f1a7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4708541d-82c0-4be9-b8e4-90954c99f1a7', 'volume_size': 2, 'source_volid': '2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'source_volstatus': 'available'}
Jun 15 04:21:17 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ff02aa4-b8cd-44d8-b1ae-b52493868094" returned: 0 in 0.910s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:17 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Cloning volume 2fbf2093-7f26-4112-9eda-379f2b10fdbf to volume 4708541d-82c0-4be9-b8e4-90954c99f1a7
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-quobyte-0ff02aa4-b8cd-44d8-b1ae-b52493868094" released by "delete_volume" :: held 1.774s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Creating offline snapshot cda7aa91-8a05-4436-8d98-104617e07c2d of volume 2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Created reservations ['68664be7-164e-4127-a8f9-71bcf3926c5a', '269055b6-4505-499a-8629-c3cd8d602a07', '0f256f1b-f27e-42b0-b01b-fab89b9e5d6d', '015e296f-fdc7-4bc0-83ad-9b31591e0b41'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[149789fd-dc6d-41ea-b8a4-836b2b0d272f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:17 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.035s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c1065f16-9f38-4fb5-b1d5-46623f8f832e tempest-GroupsV314Test-685968950 None] Delete group completed successfully.
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:17 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:17 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:18 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:18 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "cinder-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "cinder-quobyte-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-quobyte-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bded7c46-639d-4691-a508-41ab3877556c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:18 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6
Jun 15 04:21:18 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:18 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.775s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:18 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Deleted volume successfully.
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-774cdad0-0fad-4cb6-8367-78477781406e tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-0ff02aa4-b8cd-44d8-b1ae-b52493868094-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:18 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 1.105s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:18 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d 1G
Jun 15 04:21:18 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:19 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6" returned: 0 in 0.849s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:19 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6
Jun 15 04:21:19 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:19 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:19 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6" returned: 0 in 0.762s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d 1G" returned: 0 in 1.029s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-quobyte-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6" released by "delete_volume" :: held 1.711s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:19 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d
Jun 15 04:21:19 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Created reservations ['f63591eb-e42e-4656-9242-c796d02bc37a', 'cb906bb3-6ed9-490e-baca-3eb0be995cdc', '90768842-68ce-4e34-961b-23b8d60922b5', '553ecf30-21be-4642-8897-8f67026d1ee6'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:20 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:20 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:20 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.725s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Deleted volume successfully.
Jun 15 04:21:20 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d" returned: 0 in 0.900s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:20 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d is being set with open permissions: ugo+rw
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5afb7996-a711-4599-9708-16db22ead7ba tempest-ServersNegativeTestJSON-1932861891 None] Lock "cinder-1ea8dac7-89cf-4d3a-8667-7933ba52ffd6-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:20 devstack sudo[98414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d
Jun 15 04:21:20 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:21 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d" returned: 0 in 0.656s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:21 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info
Jun 15 04:21:21 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:22 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info" returned: 0 in 0.898s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:22 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info is being set with open permissions: ugo+rw
Jun 15 04:21:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:22 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info
Jun 15 04:21:22 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:23 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.info" returned: 0 in 0.962s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "cinder-quobyte-4708541d-82c0-4be9-b8e4-90954c99f1a7" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-4708541d-82c0-4be9-b8e4-90954c99f1a7" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] snapshot: cda7aa91-8a05-4436-8d98-104617e07c2d, volume: 4708541d-82c0-4be9-b8e4-90954c99f1a7,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9967b40-108f-4a2d-b31e-fb63ee589d84]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:23 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d
Jun 15 04:21:23 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:24 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d" returned: 0 in 1.206s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:21:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:21:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:21:24 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1201ef92-a5e5-4d34-ac23-ee55db3669eb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:24 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:24 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:25 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 1.134s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:25 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:21:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:25 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7
Jun 15 04:21:25 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Flow 'volume_create_manager' (0b7119e3-878c-4fb0-b050-b77de007efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989113aa-c268-4f83-afcd-750a00d2c420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989113aa-c268-4f83-afcd-750a00d2c420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1955054581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82856b8f-030d-40ed-9335-da8fd9ff2824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a95ea36e192468ba51de9b9a51d9008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:26Z,use_quota=True,user_id='8e46a310dfa547af87bd815372dd88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbd7cbb-4e62-48c9-ba23-76e9136e2283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbd7cbb-4e62-48c9-ba23-76e9136e2283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28025597-e2c6-4a5d-9c0d-ed8353e553d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28025597-e2c6-4a5d-9c0d-ed8353e553d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82856b8f-030d-40ed-9335-da8fd9ff2824', 'volume_name': 'volume-82856b8f-030d-40ed-9335-da8fd9ff2824', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474b5722-7e36-4c95-aec2-df0738668be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474b5722-7e36-4c95-aec2-df0738668be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5873a589-e69a-4b9a-a8db-20b60b2b2fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:26 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Volume 82856b8f-030d-40ed-9335-da8fd9ff2824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82856b8f-030d-40ed-9335-da8fd9ff2824', 'volume_size': 1}
Jun 15 04:21:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Acquiring lock "cinder-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "cinder-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=58,cinder:DELETE=3,cinder:UPDATE=62,cinder:INSERT=17 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=70,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=5 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Acquiring lock "cinder-quobyte-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "cinder-quobyte-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1" acquired by "delete_volume" :: waited 0.056s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5bf72-732e-4643-968e-0718a26a91f0]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:33 devstack sudo[98618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1
Jun 15 04:21:33 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:33 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7" returned: 0 in 7.920s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92d6c34-3097-4dc3-a706-afb862d342ab]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:34 devstack sudo[98654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:34 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:34 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1" returned: 0 in 1.267s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:34 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1
Jun 15 04:21:34 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:35 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 1.260s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:21:35 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Converted 1024.00 MB image at 129.28 MB/s
Jun 15 04:21:35 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 is being set with open permissions: ugo+rw
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:35 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7
Jun 15 04:21:35 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:35 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1" returned: 0 in 0.717s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "cinder-quobyte-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1" released by "delete_volume" :: held 2.182s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Created reservations ['3d5cea3a-6c3c-4181-8527-707cdd28b37d', 'a628d5a3-fbaf-4ae0-8e71-05fa69550533', 'd38f1a15-743b-44a5-98bd-6f52c5a9c7bb', '64dd83df-f738-47e3-80d4-902e6dc41e3e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:35 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:35 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:35 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:35 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:35 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7" returned: 0 in 0.814s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-4708541d-82c0-4be9-b8e4-90954c99f1a7" released by "_copy_volume_from_snapshot" :: held 12.512s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "cinder-quobyte-cda7aa91-8a05-4436-8d98-104617e07c2d" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-cda7aa91-8a05-4436-8d98-104617e07c2d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Deleting offline snapshot cda7aa91-8a05-4436-8d98-104617e07c2d of volume 2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] snapshot_file for this snap is: volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39940b-e107-4ada-b7a5-42a567d1529a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:36 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.766s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:36 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d
Jun 15 04:21:36 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Deleted volume successfully.
Jun 15 04:21:36 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-87910113-e28b-4c51-958d-e8ee6bd33f96 tempest-ServerRescueNegativeTestJSON-1035306237 None] Lock "cinder-6dc3d27a-4a4d-48b2-a944-2ce51f0559a1-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.028s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:21:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:21:37 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d" returned: 0 in 1.207s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:21:37 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e63a42-e09e-4e12-a8e7-4f8d71ccc454]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:37 devstack sudo[98685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:37 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:38 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 1.377s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:38 devstack sudo[98731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d
Jun 15 04:21:38 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:39 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d" returned: 0 in 0.960s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:39 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d
Jun 15 04:21:39 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:40 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf.cda7aa91-8a05-4436-8d98-104617e07c2d" returned: 0 in 0.866s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-cda7aa91-8a05-4436-8d98-104617e07c2d" released by "_delete_snapshot" :: held 4.574s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.950s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.106s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1955054581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82856b8f-030d-40ed-9335-da8fd9ff2824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a95ea36e192468ba51de9b9a51d9008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:26Z,use_quota=True,user_id='8e46a310dfa547af87bd815372dd88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Creating volume 82856b8f-030d-40ed-9335-da8fd9ff2824 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:40 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824 1073741824
Jun 15 04:21:40 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfac3e4-45a1-4758-9d3f-96d948df42e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4708541d-82c0-4be9-b8e4-90954c99f1a7', 'volume_size': 2, 'source_volid': '2fbf2093-7f26-4112-9eda-379f2b10fdbf', 'source_volstatus': 'available'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5729d7f5-4024-406f-b68b-615018dda235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:40 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Volume volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 (4708541d-82c0-4be9-b8e4-90954c99f1a7): created successfully
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5729d7f5-4024-406f-b68b-615018dda235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Flow 'volume_create_manager' (20633bf9-1ca6-488a-9b4c-bccce4bb2238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b305247e-48d9-4e14-92a4-368a7e5dc409 tempest-VolumesCloneTest-1566071448 None] Created volume successfully.
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "cinder-4708541d-82c0-4be9-b8e4-90954c99f1a7-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-4708541d-82c0-4be9-b8e4-90954c99f1a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "cinder-quobyte-4708541d-82c0-4be9-b8e4-90954c99f1a7" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-4708541d-82c0-4be9-b8e4-90954c99f1a7" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeca488-2021-4e98-84e5-30af0bfd185b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:41 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824 1073741824" returned: 0 in 1.091s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:41 devstack sudo[98759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824
Jun 15 04:21:41 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:41 devstack sudo[98758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7
Jun 15 04:21:41 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:42 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7" returned: 0 in 1.072s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:42 devstack sudo[98766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7
Jun 15 04:21:42 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:42 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824" returned: 0 in 1.040s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5873a589-e69a-4b9a-a8db-20b60b2b2fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82856b8f-030d-40ed-9335-da8fd9ff2824', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6261ebf-677c-4b39-8321-22a512f16ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:42 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Volume volume-82856b8f-030d-40ed-9335-da8fd9ff2824 (82856b8f-030d-40ed-9335-da8fd9ff2824): created successfully
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6261ebf-677c-4b39-8321-22a512f16ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Flow 'volume_create_manager' (0b7119e3-878c-4fb0-b050-b77de007efec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d9ad0f1a-4449-430e-a025-96aec6dff21d tempest-VolumeQuotasAdminTestJSON-1404082435 None] Created volume successfully.
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "cinder-82856b8f-030d-40ed-9335-da8fd9ff2824-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "cinder-82856b8f-030d-40ed-9335-da8fd9ff2824-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "cinder-quobyte-82856b8f-030d-40ed-9335-da8fd9ff2824" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "cinder-quobyte-82856b8f-030d-40ed-9335-da8fd9ff2824" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6421df12-b677-4412-a060-41c71078ba5d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:43 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824
Jun 15 04:21:43 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:43 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4708541d-82c0-4be9-b8e4-90954c99f1a7" returned: 0 in 1.032s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-4708541d-82c0-4be9-b8e4-90954c99f1a7" released by "delete_volume" :: held 2.196s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:43 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Created reservations ['573b3a36-f088-450e-93d8-eab8df841c47', '50764eca-d37a-4c1d-80ea-0f1587836d97', 'f4985108-587d-4cbc-a60b-da31315490c9', '5b05e8ba-64c5-45bb-976b-a47e05e7063e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:44 devstack sudo[98780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:44 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:44 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824" returned: 0 in 1.007s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:44 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824
Jun 15 04:21:44 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:44 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.812s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Deleted volume successfully.
Jun 15 04:21:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7ac1bce0-dd41-4bbb-88bb-ee98ea864473 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-4708541d-82c0-4be9-b8e4-90954c99f1a7-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "cinder-2fbf2093-7f26-4112-9eda-379f2b10fdbf-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-2fbf2093-7f26-4112-9eda-379f2b10fdbf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "cinder-quobyte-2fbf2093-7f26-4112-9eda-379f2b10fdbf" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-2fbf2093-7f26-4112-9eda-379f2b10fdbf" acquired by "delete_volume" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c88ebb-1e0d-4e00-ae04-6f0ceee172e4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:45 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-82856b8f-030d-40ed-9335-da8fd9ff2824" returned: 0 in 0.704s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:45 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:45 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "cinder-quobyte-82856b8f-030d-40ed-9335-da8fd9ff2824" released by "delete_volume" :: held 1.819s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Created reservations ['11d2ec9f-938d-4501-8f12-2d46ccb63487', '3b75d1bb-5728-4b37-ae6a-30796d97f049', 'f8b600f1-15b0-4a72-b378-9c16139dfd30', '64252092-42ce-41b6-9c56-07ee83d319cb'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:45 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:45 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:46 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.838s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Deleted volume successfully.
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a521fce8-a6dd-4de6-8216-d49acba6a394 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "cinder-82856b8f-030d-40ed-9335-da8fd9ff2824-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:46 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 1.370s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:46 devstack sudo[98837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf
Jun 15 04:21:46 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Flow 'volume_create_manager' (4f2fc810-77d5-4325-b947-bb555322bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2453304-9e68-4307-a2dd-db973a156361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2453304-9e68-4307-a2dd-db973a156361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1014167742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d2ea5b-bd63-468d-b543-ab35d59e185f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a95ea36e192468ba51de9b9a51d9008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:47Z,use_quota=True,user_id='8e46a310dfa547af87bd815372dd88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1146dd5-72df-4a14-8062-dc58cce8f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1146dd5-72df-4a14-8062-dc58cce8f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4b1d88-cfea-489a-ac81-c658aa77ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4b1d88-cfea-489a-ac81-c658aa77ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d2ea5b-bd63-468d-b543-ab35d59e185f', 'volume_name': 'volume-97d2ea5b-bd63-468d-b543-ab35d59e185f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b92a26-9145-4db7-8906-c4f0063f16eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b92a26-9145-4db7-8906-c4f0063f16eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbab5644-0fb4-40df-9365-e6fec2c2f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:46 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Volume 97d2ea5b-bd63-468d-b543-ab35d59e185f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d2ea5b-bd63-468d-b543-ab35d59e185f', 'volume_size': 1}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1014167742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d2ea5b-bd63-468d-b543-ab35d59e185f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a95ea36e192468ba51de9b9a51d9008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:47Z,use_quota=True,user_id='8e46a310dfa547af87bd815372dd88c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Creating volume 97d2ea5b-bd63-468d-b543-ab35d59e185f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:46 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:46 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f 1073741824
Jun 15 04:21:46 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:47 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2fbf2093-7f26-4112-9eda-379f2b10fdbf" returned: 0 in 0.865s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-quobyte-2fbf2093-7f26-4112-9eda-379f2b10fdbf" released by "delete_volume" :: held 2.307s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Created reservations ['75ece701-d49c-4cb0-872f-dee677c46a32', 'af59d322-f6c6-4b9b-a342-a3a3cf0d473e', '14917b60-b573-422f-9841-9df30ee0cec0', '340a31ba-ee49-4059-9a40-d67fbd6b1e39'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:47 devstack sudo[98847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:47 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:47 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f 1073741824" returned: 0 in 1.046s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:47 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f
Jun 15 04:21:47 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:48 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.637s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Deleted volume successfully.
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-14bb6397-5d4a-47a7-98a0-6276f4897b11 tempest-VolumesCloneTest-1566071448 None] Lock "cinder-2fbf2093-7f26-4112-9eda-379f2b10fdbf-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:48 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f" returned: 0 in 0.638s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbab5644-0fb4-40df-9365-e6fec2c2f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d2ea5b-bd63-468d-b543-ab35d59e185f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb98fa1-a506-4018-b658-e4eb4b57cac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:48 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Volume volume-97d2ea5b-bd63-468d-b543-ab35d59e185f (97d2ea5b-bd63-468d-b543-ab35d59e185f): created successfully
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb98fa1-a506-4018-b658-e4eb4b57cac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Flow 'volume_create_manager' (4f2fc810-77d5-4325-b947-bb555322bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-29880d2f-64bf-45f9-a07b-aa867448a035 tempest-VolumeQuotasAdminTestJSON-1404082435 None] Created volume successfully.
Jun 15 04:21:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3c810292-898d-4724-b366-3d2703f44b2d tempest-VolumeQuotasAdminTestJSON-688996973 None] Transfer volume completed successfully.
Jun 15 04:21:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Acquiring lock "cinder-97d2ea5b-bd63-468d-b543-ab35d59e185f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Lock "cinder-97d2ea5b-bd63-468d-b543-ab35d59e185f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Acquiring lock "cinder-quobyte-97d2ea5b-bd63-468d-b543-ab35d59e185f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Lock "cinder-quobyte-97d2ea5b-bd63-468d-b543-ab35d59e185f" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a1b6d1-f4c2-4bb2-82de-33d4022893f8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:51 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f
Jun 15 04:21:51 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:51 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (8ac8d0a1-21e1-49c3-8632-96655720bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb1039-cea0-4cc2-bcdb-e96028567a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f" returned: 0 in 0.980s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb1039-cea0-4cc2-bcdb-e96028567a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1476618313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1ccc32-bd8f-4434-b726-bac8f89475ac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:52Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4e5caf-70e5-4c6f-99ba-08fdf61fef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4e5caf-70e5-4c6f-99ba-08fdf61fef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df29aafb-fd83-44a5-a6b8-737d50b88bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:51 devstack sudo[98860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f
Jun 15 04:21:51 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df29aafb-fd83-44a5-a6b8-737d50b88bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1ccc32-bd8f-4434-b726-bac8f89475ac', 'volume_name': 'volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0565866e-ab00-4d24-8b1e-ff3b2540d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0565866e-ab00-4d24-8b1e-ff3b2540d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f12154-2b13-4c7b-8ddc-abf75c0d35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:51 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Volume 7b1ccc32-bd8f-4434-b726-bac8f89475ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac', 'volume_size': 1}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1476618313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1ccc32-bd8f-4434-b726-bac8f89475ac,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:52Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Creating volume 7b1ccc32-bd8f-4434-b726-bac8f89475ac {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:51 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:51 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac 1073741824
Jun 15 04:21:52 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:52 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-97d2ea5b-bd63-468d-b543-ab35d59e185f" returned: 0 in 1.121s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Lock "cinder-quobyte-97d2ea5b-bd63-468d-b543-ab35d59e185f" released by "delete_volume" :: held 2.160s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Created reservations ['302601f8-7e16-45ca-bccc-6935dc0e4840', '1371f346-15b2-4607-bcab-cd40544985f2', '55442b87-bee2-4466-ab7f-1f08ee6b0e6a', 'de390253-7f90-4761-84ed-54ab9cda4652'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:21:53 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac 1073741824" returned: 0 in 1.142s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:53 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac
Jun 15 04:21:53 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:53 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:21:53 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:54 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac" returned: 0 in 0.886s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f12154-2b13-4c7b-8ddc-abf75c0d35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c624172-0def-466c-a062-dbb52a1b70fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:54 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Volume volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac (7b1ccc32-bd8f-4434-b726-bac8f89475ac): created successfully
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c624172-0def-466c-a062-dbb52a1b70fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (8ac8d0a1-21e1-49c3-8632-96655720bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-097be370-b430-4566-a389-971864931074 tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:21:54 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.919s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:21:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Deleted volume successfully.
Jun 15 04:21:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0d654a1a-6c0e-449b-b432-eb184e72a13e tempest-VolumeQuotasAdminTestJSON-1773365126 None] Lock "cinder-97d2ea5b-bd63-468d-b543-ab35d59e185f-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (d5a48ff3-764f-4a2a-b56d-a2e2d4549aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6b3428-9d5c-4d3c-b883-6192e05245d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6b3428-9d5c-4d3c-b883-6192e05245d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1624687591',display_name='tempest-VolumesGetTest-Volume-670298490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc067e3-7aa2-4962-966f-ef705cb0e1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:56Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8019ce-dd2e-47e3-b50d-b070fcc8204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8019ce-dd2e-47e3-b50d-b070fcc8204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7796bb-2466-4e82-92cd-f8989050ca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7796bb-2466-4e82-92cd-f8989050ca8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc067e3-7aa2-4962-966f-ef705cb0e1f5', 'volume_name': 'volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a57682-3adc-4b7b-87e4-0ca4e273958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a57682-3adc-4b7b-87e4-0ca4e273958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73aae5e6-3dff-41e4-ba02-e9e675b4f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:56 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Volume ecc067e3-7aa2-4962-966f-ef705cb0e1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5', 'volume_size': 1}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:21:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1624687591',display_name='tempest-VolumesGetTest-Volume-670298490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc067e3-7aa2-4962-966f-ef705cb0e1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:21:56Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Creating volume ecc067e3-7aa2-4962-966f-ef705cb0e1f5 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:21:56 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:21:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:56 devstack sudo[98876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 1073741824
Jun 15 04:21:56 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:57 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 1073741824" returned: 0 in 1.192s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:57 devstack sudo[98883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5
Jun 15 04:21:57 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:21:58 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5" returned: 0 in 0.730s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73aae5e6-3dff-41e4-ba02-e9e675b4f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f80b11f-1920-4fe3-af93-51163ba453a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:21:58 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Volume volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 (ecc067e3-7aa2-4962-966f-ef705cb0e1f5): created successfully
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f80b11f-1920-4fe3-af93-51163ba453a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:21:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (d5a48ff3-764f-4a2a-b56d-a2e2d4549aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:21:58 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6a3b0955-6f63-4ad8-9626-abb9c295f016 tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:21:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-ecc067e3-7aa2-4962-966f-ef705cb0e1f5-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Lock "cinder-ecc067e3-7aa2-4962-966f-ef705cb0e1f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-ecc067e3-7aa2-4962-966f-ef705cb0e1f5" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:21:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-ecc067e3-7aa2-4962-966f-ef705cb0e1f5" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:21:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b22de-9713-457c-9024-b2f020c5fe07]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:21:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:21:59 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5
Jun 15 04:21:59 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:00 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5" returned: 0 in 0.884s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:00 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5
Jun 15 04:22:00 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-56d2ad48-93be-432d-ba50-85263e8bd698 tempest-GroupSnapshotsTest-1703780758 None] Group tempest-GroupSnapshotsTest-Group-1832408184: creating
Jun 15 04:22:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-56d2ad48-93be-432d-ba50-85263e8bd698 tempest-GroupSnapshotsTest-1703780758 None] Group tempest-GroupSnapshotsTest-Group-1832408184: created successfully
Jun 15 04:22:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-56d2ad48-93be-432d-ba50-85263e8bd698 tempest-GroupSnapshotsTest-1703780758 None] Create group completed successfully.
Jun 15 04:22:01 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ecc067e3-7aa2-4962-966f-ef705cb0e1f5" returned: 0 in 0.763s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-ecc067e3-7aa2-4962-966f-ef705cb0e1f5" released by "delete_volume" :: held 1.713s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Created reservations ['e7054c95-7635-43f8-b2d9-d53bb4c8167b', 'ea1f62be-08bd-471c-9295-8797b24d66e7', 'bf123e14-7c95-4434-8b43-73937509c59e', '784b9ee5-c4ac-469e-a4ca-08f02b2dd2cd'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:01 devstack sudo[98897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:01 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-7b1ccc32-bd8f-4434-b726-bac8f89475ac-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Lock "cinder-7b1ccc32-bd8f-4434-b726-bac8f89475ac-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-7b1ccc32-bd8f-4434-b726-bac8f89475ac" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-7b1ccc32-bd8f-4434-b726-bac8f89475ac" acquired by "delete_volume" :: waited 0.050s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d130a0a7-bf2e-4e70-840a-574a804dbbdc]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:02 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac
Jun 15 04:22:02 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:02 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.069s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-121d4d45-2be8-4d6b-b737-c533c26be9f4 tempest-VolumesGetTest-914961845 None] Lock "cinder-ecc067e3-7aa2-4962-966f-ef705cb0e1f5-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (4c540fec-330e-4475-81be-1ac56985203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc051f0-5e47-41ad-b716-5bc4fa3009ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc051f0-5e47-41ad-b716-5bc4fa3009ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818843617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=72f3f8d5-fdd4-42ab-b47b-096012aaa37e,host='devstack@QuobyteHD#QuobyteHD',id=69656771-fa64-444b-b821-e2e83e47900e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:03Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd6e8da4-12d8-45fd-b17d-4a1cdcf80409),volume_type_id=bd6e8da4-12d8-45fd-b17d-4a1cdcf80409)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a258481-6561-4973-874c-2efc0be63b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a258481-6561-4973-874c-2efc0be63b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0d9d68-75c4-42a6-a8f0-3fdae82c44f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0d9d68-75c4-42a6-a8f0-3fdae82c44f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69656771-fa64-444b-b821-e2e83e47900e', 'volume_name': 'volume-69656771-fa64-444b-b821-e2e83e47900e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0752b9d4-1575-4f6a-9336-fc399af0ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0752b9d4-1575-4f6a-9336-fc399af0ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd440b0-eb46-4493-8e22-32789386f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Volume 69656771-fa64-444b-b821-e2e83e47900e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69656771-fa64-444b-b821-e2e83e47900e', 'volume_size': 1}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=72f3f8d5-fdd4-42ab-b47b-096012aaa37e,created_at=2026-06-15T02:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818843617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=72f3f8d5-fdd4-42ab-b47b-096012aaa37e,host='devstack@QuobyteHD#QuobyteHD',id=69656771-fa64-444b-b821-e2e83e47900e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:03Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd6e8da4-12d8-45fd-b17d-4a1cdcf80409),volume_type_id=bd6e8da4-12d8-45fd-b17d-4a1cdcf80409)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Creating volume 69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:02 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:02 devstack sudo[98902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e 1073741824
Jun 15 04:22:02 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:03 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac" returned: 0 in 0.939s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:03 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac
Jun 15 04:22:03 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:03 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b1ccc32-bd8f-4434-b726-bac8f89475ac" returned: 0 in 0.665s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-7b1ccc32-bd8f-4434-b726-bac8f89475ac" released by "delete_volume" :: held 1.689s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:03 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e 1073741824" returned: 0 in 0.995s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Created reservations ['abc23115-ded6-488f-a0ef-f133cb383be0', 'da15ec02-5c65-49bd-a907-eb6bf0888c76', '31b62e92-df08-4e66-9abc-aba68b17680d', '39425f1a-c7fe-4bb7-86e0-2ddda7e82c8a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:03 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:03 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:04 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:04 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:04 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 0.746s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd440b0-eb46-4493-8e22-32789386f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69656771-fa64-444b-b821-e2e83e47900e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199d310d-60ec-4f92-85a2-cf5ceb159d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Volume volume-69656771-fa64-444b-b821-e2e83e47900e (69656771-fa64-444b-b821-e2e83e47900e): created successfully
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199d310d-60ec-4f92-85a2-cf5ceb159d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (4c540fec-330e-4475-81be-1ac56985203b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9e646780-e22f-480c-8de5-b7c9d57d7b3a tempest-GroupSnapshotsTest-1703780758 None] Created volume successfully.
Jun 15 04:22:04 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.887s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cd633c14-ba4a-4154-95e8-0fa7b6d502d6 tempest-VolumesGetTest-914961845 None] Lock "cinder-7b1ccc32-bd8f-4434-b726-bac8f89475ac-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:04 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (654b7605-51f9-43c3-9e1f-386bedbecbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f2dc83-d6a9-464c-8515-e2928f401c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f2dc83-d6a9-464c-8515-e2928f401c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-135980644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b055c2d2-0d71-4edf-8851-69fac3bc2ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:05Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6e046f-e458-41fa-9d6c-65fce317777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6e046f-e458-41fa-9d6c-65fce317777e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8d9853-1ce3-4d72-88e0-82a15de2dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8d9853-1ce3-4d72-88e0-82a15de2dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'volume_name': 'volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c7855d-2bbb-4123-82fe-24a8aa1e7179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c7855d-2bbb-4123-82fe-24a8aa1e7179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4e369e-15a9-4646-ae33-f4f998830a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:05 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Volume b055c2d2-0d71-4edf-8851-69fac3bc2ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'volume_size': 1}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-135980644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b055c2d2-0d71-4edf-8851-69fac3bc2ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:05Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Creating volume b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:05 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:05 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded 1073741824
Jun 15 04:22:05 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] GroupSnapshot b398e593-bbd1-4d53-ad17-9bd2b5292203: creating.
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Group snapshot b398e593-bbd1-4d53-ad17-9bd2b5292203: creating. {{(pid=92103) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 04:22:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:06 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded 1073741824" returned: 0 in 0.936s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:06 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:06 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:06 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.678s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.458s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4e369e-15a9-4646-ae33-f4f998830a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab15beb-0837-482d-aee8-af87b1e08975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Creating offline snapshot e0904fc6-d0c3-48b4-8741-56ab0824ebfe of volume 69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:22:06 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Volume volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded (b055c2d2-0d71-4edf-8851-69fac3bc2ded): created successfully
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab15beb-0837-482d-aee8-af87b1e08975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (654b7605-51f9-43c3-9e1f-386bedbecbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd84e334-0de1-4c17-b140-b76583de7d06]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1be6114a-68dc-4d37-be2b-401a74d0cf09 tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:22:06 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:06 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:07 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 1.056s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:07 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe 1G
Jun 15 04:22:07 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:07 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (dbeeaf69-f891-4d28-859e-edf34f18a2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b95610-1fa0-440c-b042-721e1e2bda50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b95610-1fa0-440c-b042-721e1e2bda50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1514872143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cb05c3-dbec-4c07-9794-e22c2dac1e68,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b055c2d2-0d71-4edf-8851-69fac3bc2ded,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:08Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b199c5-96ed-418d-ae92-a478a868662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b199c5-96ed-418d-ae92-a478a868662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e9de9e-bae9-41a6-bf0e-870c3e7aa680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e9de9e-bae9-41a6-bf0e-870c3e7aa680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '17cb05c3-dbec-4c07-9794-e22c2dac1e68', 'volume_name': 'volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68', 'volume_size': 1, 'source_volid': 'b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'source_volstatus': 'available'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d545df0d-a37b-4c72-b229-3b3a7e3e77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d545df0d-a37b-4c72-b229-3b3a7e3e77c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdb3043-1cab-4a27-b829-5a7f306cf52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Volume 17cb05c3-dbec-4c07-9794-e22c2dac1e68: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68', 'volume_size': 1, 'source_volid': 'b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'source_volstatus': 'available'}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:08 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe 1G" returned: 0 in 0.969s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69656771-fa64-444b-b821-e2e83e47900e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:08 devstack sudo[98951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69656771-fa64-444b-b821-e2e83e47900e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe
Jun 15 04:22:08 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:09 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69656771-fa64-444b-b821-e2e83e47900e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe" returned: 0 in 0.726s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:09 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:22:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:09 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe
Jun 15 04:22:09 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Flow 'volume_create_manager' (6da609db-db03-46d9-95de-a22f19ac0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d878172d-19a1-434f-8c94-eac627f98051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d878172d-19a1-434f-8c94-eac627f98051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-528381504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='620d560afa70418bad84cb895175685b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:10Z,use_quota=True,user_id='9de4a9139a8b41b987d3a731c8d5be56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf211b78-af7e-404f-bdf9-45da9b56be11),volume_type_id=cf211b78-af7e-404f-bdf9-45da9b56be11)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab69081-de0b-4738-8c7a-5ac5ea9e59cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab69081-de0b-4738-8c7a-5ac5ea9e59cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce4bbea-014e-4916-86e3-fda16ac28c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce4bbea-014e-4916-86e3-fda16ac28c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79', 'volume_name': 'volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de99c047-ffdd-4fdc-8478-d84e41235811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de99c047-ffdd-4fdc-8478-d84e41235811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4aec02-7c23-4e03-ac0e-53bbf8d60b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:10 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Volume 78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79', 'volume_size': 1}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:10 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe" returned: 0 in 0.635s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:10 devstack sudo[98965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info
Jun 15 04:22:10 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:10 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info" returned: 0 in 0.616s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:10 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:22:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:10 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info
Jun 15 04:22:10 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:11 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.info" returned: 0 in 0.596s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.729s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.306s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:11 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Cloning volume b055c2d2-0d71-4edf-8851-69fac3bc2ded to volume 17cb05c3-dbec-4c07-9794-e22c2dac1e68
Jun 15 04:22:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Creating offline snapshot 2b1170c2-4298-44a8-b588-3add76757661 of volume b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:22:11 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de90bb8-e272-4a84-924d-99eb8f870966]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0b6705ac-955b-44f8-8279-b96dd551e132 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot b398e593-bbd1-4d53-ad17-9bd2b5292203: created successfully
Jun 15 04:22:11 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:11 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:12 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.732s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:12 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 1G
Jun 15 04:22:12 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:13 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 1G" returned: 0 in 0.793s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:13 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661
Jun 15 04:22:13 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:13 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661" returned: 0 in 0.720s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:13 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 is being set with open permissions: ugo+rw
Jun 15 04:22:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:13 devstack sudo[99011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661
Jun 15 04:22:13 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:14 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661" returned: 0 in 0.954s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:14 devstack sudo[99054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info
Jun 15 04:22:14 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:15 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info" returned: 0 in 0.665s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:15 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info is being set with open permissions: ugo+rw
Jun 15 04:22:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:15 devstack sudo[99058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info
Jun 15 04:22:15 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:16 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.info" returned: 0 in 0.701s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-17cb05c3-dbec-4c07-9794-e22c2dac1e68" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-17cb05c3-dbec-4c07-9794-e22c2dac1e68" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] snapshot: 2b1170c2-4298-44a8-b588-3add76757661, volume: 17cb05c3-dbec-4c07-9794-e22c2dac1e68,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9065ce3f-d950-4a45-88f1-f362a644a753]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:16 devstack sudo[99061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661
Jun 15 04:22:16 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:17 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661" returned: 0 in 0.792s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf063b1-cabe-4608-a046-dc5f1f647908]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:17 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:17 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:17 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.821s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:22:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:17 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68
Jun 15 04:22:17 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:23 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68" returned: 0 in 5.372s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:23 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[37239d13-9092-4039-866c-6be63dfe3e07]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:23 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:23 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:24 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.897s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:22:24 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Converted 1024.00 MB image at 190.58 MB/s
Jun 15 04:22:24 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 is being set with open permissions: ugo+rw
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:24 devstack sudo[99092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68
Jun 15 04:22:24 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=67,cinder:INSERT=19,cinder:UPDATE=90,cinder:DELETE=5 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=73,cinder:DELETE=9 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:22:24 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68" returned: 0 in 0.652s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-17cb05c3-dbec-4c07-9794-e22c2dac1e68" released by "_copy_volume_from_snapshot" :: held 8.634s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-2b1170c2-4298-44a8-b588-3add76757661" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-2b1170c2-4298-44a8-b588-3add76757661" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Deleting offline snapshot 2b1170c2-4298-44a8-b588-3add76757661 of volume b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] snapshot_file for this snap is: volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bfd842-2f8c-4f3f-805a-0f3b675e726a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:24 devstack sudo[99103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661
Jun 15 04:22:25 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:25 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661" returned: 0 in 0.733s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:22:25 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c3007-a970-470f-95c7-9789b398e6a3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:25 devstack sudo[99108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:25 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:26 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.731s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:26 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661
Jun 15 04:22:26 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:27 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661" returned: 0 in 0.700s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:27 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661
Jun 15 04:22:27 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:27 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded.2b1170c2-4298-44a8-b588-3add76757661" returned: 0 in 0.607s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-2b1170c2-4298-44a8-b588-3add76757661" released by "_delete_snapshot" :: held 2.868s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.295s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.579s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-528381504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='620d560afa70418bad84cb895175685b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:10Z,use_quota=True,user_id='9de4a9139a8b41b987d3a731c8d5be56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf211b78-af7e-404f-bdf9-45da9b56be11),volume_type_id=cf211b78-af7e-404f-bdf9-45da9b56be11)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Creating volume 78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:27 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdb3043-1cab-4a27-b829-5a7f306cf52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68', 'volume_size': 1, 'source_volid': 'b055c2d2-0d71-4edf-8851-69fac3bc2ded', 'source_volstatus': 'available'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b3de0e-cbfa-4e7d-b9e6-7ae33e53d3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:27 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 1073741824
Jun 15 04:22:27 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Volume volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 (17cb05c3-dbec-4c07-9794-e22c2dac1e68): created successfully
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b3de0e-cbfa-4e7d-b9e6-7ae33e53d3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (dbeeaf69-f891-4d28-859e-edf34f18a2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:27 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0b27b72d-737e-43b5-9084-3b3965a150cf tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:22:28 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 1073741824" returned: 0 in 0.825s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:28 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79
Jun 15 04:22:28 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:29 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79" returned: 0 in 0.689s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 16.657s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-e0904fc6-d0c3-48b4-8741-56ab0824ebfe-66f45f7b-16d3-4ff4-be82-509f231b2e9c" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4aec02-7c23-4e03-ac0e-53bbf8d60b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5931568a-94df-48f5-bb42-cbfcad39942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Volume volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 (78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79): created successfully
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5931568a-94df-48f5-bb42-cbfcad39942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Flow 'volume_create_manager' (6da609db-db03-46d9-95de-a22f19ac0d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-e0904fc6-d0c3-48b4-8741-56ab0824ebfe-66f45f7b-16d3-4ff4-be82-509f231b2e9c" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Creating volume 66f45f7b-16d3-4ff4-be82-509f231b2e9c from snapshot e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-66f45f7b-16d3-4ff4-be82-509f231b2e9c" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (f2b19904-bbca-442b-922e-385db2926fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa9c149-24c5-42e4-995f-2f311b2cc66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-01d27590-9d3e-4c40-a74b-6abc65077853 tempest-VolumeTypesAccessTest-1331866910 None] Created volume successfully.
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-66f45f7b-16d3-4ff4-be82-509f231b2e9c" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] snapshot: e0904fc6-d0c3-48b4-8741-56ab0824ebfe, volume: 66f45f7b-16d3-4ff4-be82-509f231b2e9c,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa9c149-24c5-42e4-995f-2f311b2cc66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1718611258',display_name='tempest-VolumesGetTest-Volume-1880169722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4cbd8c-4d6f-4385-b19c-e22e1b160d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:29Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b645e76d-20ef-404c-bfc5-dd7d125481c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b645e76d-20ef-404c-bfc5-dd7d125481c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d788c5c5-41a2-41f0-b1f4-f2342dd6353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d788c5c5-41a2-41f0-b1f4-f2342dd6353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4cbd8c-4d6f-4385-b19c-e22e1b160d6a', 'volume_name': 'volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a746a401-4aa1-41ca-ac9d-f62c1335ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a746a401-4aa1-41ca-ac9d-f62c1335ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ff5df0-1ff0-4702-a01c-1a1269d147f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Volume df4cbd8c-4d6f-4385-b19c-e22e1b160d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a', 'volume_size': 1}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a38fca-28f2-4985-a18e-aa88e473150f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:29 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe
Jun 15 04:22:29 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Acquiring lock "cinder-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Lock "cinder-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Acquiring lock "cinder-quobyte-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Lock "cinder-quobyte-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9066f3-122a-43ec-b130-b8d971dea42a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:30 devstack sudo[99160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79
Jun 15 04:22:30 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:30 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe" returned: 0 in 0.744s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69656771-fa64-444b-b821-e2e83e47900e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1685ecf1-f82e-4711-969b-00f8c39dee9a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:30 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:30 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:30 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79" returned: 0 in 0.736s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:30 devstack sudo[99170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79
Jun 15 04:22:30 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:31 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 0.717s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:31 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c
Jun 15 04:22:31 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:31 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79" returned: 0 in 0.612s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Lock "cinder-quobyte-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79" released by "delete_volume" :: held 1.393s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:31 devstack cinder-volume[92103]: WARNING cinder.quota [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1486234911 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1486234911, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:22:31 devstack cinder-volume[92103]: WARNING cinder.quota [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1486234911 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1486234911, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Created reservations ['19cacac1-5d38-4e62-b80a-ceda1d3e7b4a', '5a4c8815-128f-48f5-bf71-366b107b0848', 'f8e49845-69f2-429c-9959-ed0dc4fb5484', 'fca4c85a-a396-4a3c-bb8d-fd343dbcbc8f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:31 devstack sudo[99180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:31 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:32 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.973s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:32 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Deleted volume successfully.
Jun 15 04:22:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1668da3d-0cdf-4550-a0f1-8d9c90088a86 tempest-VolumeTypesAccessTest-1331866910 None] Lock "cinder-78d8ee30-95c3-4cd3-a1c9-ff37e82d1b79-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:35 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:35 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c" returned: 0 in 5.698s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c1763-82ac-4517-b06c-61e0eb936d79]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:36 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.324s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:22:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:22:36 devstack sudo[99231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:36 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:37 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 0.966s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:37 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:22:37 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Converted 1024.00 MB image at 179.69 MB/s
Jun 15 04:22:37 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:22:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:37 devstack sudo[99237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c
Jun 15 04:22:37 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:38 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-66f45f7b-16d3-4ff4-be82-509f231b2e9c" released by "_copy_volume_from_snapshot" :: held 9.042s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-e0904fc6-d0c3-48b4-8741-56ab0824ebfe-66f45f7b-16d3-4ff4-be82-509f231b2e9c" released by "_create_volume_from_snapshot" :: held 9.118s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.179s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.021s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1718611258',display_name='tempest-VolumesGetTest-Volume-1880169722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4cbd8c-4d6f-4385-b19c-e22e1b160d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:29Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Creating volume df4cbd8c-4d6f-4385-b19c-e22e1b160d6a {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:38 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:38 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a 1073741824
Jun 15 04:22:38 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-eb5a3cc3-0fde-43ce-becb-77714da3af03 tempest-GroupSnapshotsTest-1703780758 None] Create group from source-snapshot-b398e593-bbd1-4d53-ad17-9bd2b5292203 completed successfully.
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Flow 'volume_create_manager' (c53d5d0e-2730-4d4e-af19-e224ffd97cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c105a58f-6be2-4cc7-aa55-c911cb0f3b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c105a58f-6be2-4cc7-aa55-c911cb0f3b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1107768371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46b0729-84f1-4930-a726-eeca7b676194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ba38ddadf7489a880b2f0386b5412d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:39Z,use_quota=True,user_id='19d31faf49744008bfe021d12c888903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4626f5c-638a-4b5e-9c6b-b273b23a336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4626f5c-638a-4b5e-9c6b-b273b23a336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed5466c-3bf5-4a8b-87f7-54e4f34c9881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed5466c-3bf5-4a8b-87f7-54e4f34c9881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46b0729-84f1-4930-a726-eeca7b676194', 'volume_name': 'volume-a46b0729-84f1-4930-a726-eeca7b676194', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857d38c8-98d2-4d38-a506-3d6e74086b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857d38c8-98d2-4d38-a506-3d6e74086b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0141d92-b481-4145-97f7-1c67c7e04717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:39 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Volume a46b0729-84f1-4930-a726-eeca7b676194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46b0729-84f1-4930-a726-eeca7b676194', 'volume_size': 1}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:39 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a 1073741824" returned: 0 in 1.003s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:39 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a
Jun 15 04:22:39 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-66f45f7b-16d3-4ff4-be82-509f231b2e9c" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-66f45f7b-16d3-4ff4-be82-509f231b2e9c" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef9745f-c2bf-4eda-bed7-457b9f2a10e6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:40 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c
Jun 15 04:22:40 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:40 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1107768371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46b0729-84f1-4930-a726-eeca7b676194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ba38ddadf7489a880b2f0386b5412d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:39Z,use_quota=True,user_id='19d31faf49744008bfe021d12c888903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Creating volume a46b0729-84f1-4930-a726-eeca7b676194 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ff5df0-1ff0-4702-a01c-1a1269d147f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:40 devstack sudo[99254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 1073741824
Jun 15 04:22:40 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7abbdb3-8ba2-4fdb-81c5-4c462904e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:40 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Volume volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a (df4cbd8c-4d6f-4385-b19c-e22e1b160d6a): created successfully
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7abbdb3-8ba2-4fdb-81c5-4c462904e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (f2b19904-bbca-442b-922e-385db2926fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-caa23758-a800-48f8-95f1-8ce2b1a876b3 tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:22:40 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c" returned: 0 in 0.894s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:40 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c
Jun 15 04:22:40 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:41 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 1073741824" returned: 0 in 0.950s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:41 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194
Jun 15 04:22:41 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:41 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66f45f7b-16d3-4ff4-be82-509f231b2e9c" returned: 0 in 0.664s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-66f45f7b-16d3-4ff4-be82-509f231b2e9c" released by "delete_volume" :: held 1.643s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['82cb0c92-6ed3-471c-9f47-8396e5bda951'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:41 devstack cinder-volume[92103]: WARNING cinder.quota [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2042757090 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2042757090, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:22:41 devstack cinder-volume[92103]: WARNING cinder.quota [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2042757090 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2042757090, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Lock "cinder-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['2a3321a8-3775-483c-b549-f5984dfd0042', 'a159d418-b842-43be-bb82-d8f6be592e96', 'fbdceb10-436f-45a8-830c-4ea901681a8f', 'd828d507-f70a-4eb8-b6c2-e40d2c27649a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee53a05-f6e5-43aa-b1c1-98796ae0547c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:41 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:41 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:41 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194" returned: 0 in 0.697s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:41 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a
Jun 15 04:22:41 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0141d92-b481-4145-97f7-1c67c7e04717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46b0729-84f1-4930-a726-eeca7b676194', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a224eeca-e713-417c-bcad-fb9788ca657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:42 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Volume volume-a46b0729-84f1-4930-a726-eeca7b676194 (a46b0729-84f1-4930-a726-eeca7b676194): created successfully
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a224eeca-e713-417c-bcad-fb9788ca657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Flow 'volume_create_manager' (c53d5d0e-2730-4d4e-af19-e224ffd97cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-43fe49ee-cbd6-4d47-9558-e93535dedad8 tempest-AttachVolumeShelveTestJSON-2068040000 None] Created volume successfully.
Jun 15 04:22:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot b398e593-bbd1-4d53-ad17-9bd2b5292203: deleting
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot b398e593-bbd1-4d53-ad17-9bd2b5292203: deleting {{(pid=92103) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-69656771-fa64-444b-b821-e2e83e47900e" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-69656771-fa64-444b-b821-e2e83e47900e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-e0904fc6-d0c3-48b4-8741-56ab0824ebfe" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-e0904fc6-d0c3-48b4-8741-56ab0824ebfe" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Deleting offline snapshot e0904fc6-d0c3-48b4-8741-56ab0824ebfe of volume 69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] snapshot_file for this snap is: volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc2a750-97fb-4baa-9826-db9a9f03ac7f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:42 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe
Jun 15 04:22:42 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:42 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.878s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-41f04d94-a0dc-4aff-8008-3af1139f5fb3 tempest-GroupSnapshotsTest-1703780758 None] Delete group completed successfully.
Jun 15 04:22:42 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a" returned: 0 in 0.998s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:42 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a
Jun 15 04:22:42 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:43 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe" returned: 0 in 0.951s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69656771-fa64-444b-b821-e2e83e47900e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415e249-7fbc-445c-bb7d-d4623a62f3f1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:43 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a" returned: 0 in 0.695s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a" released by "delete_volume" :: held 1.747s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Created reservations ['a077b69c-1279-422f-8692-d2e958baa54c', '17e0d86e-e6e4-4f64-9a6a-3a80cfc10963', '7b113a26-8997-457b-a050-6172242e396d', '304b6169-04c5-4932-8303-3ddc7af2b86b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:43 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:43 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:43 devstack sudo[99293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:43 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-17cb05c3-dbec-4c07-9794-e22c2dac1e68-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Lock "cinder-17cb05c3-dbec-4c07-9794-e22c2dac1e68-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-17cb05c3-dbec-4c07-9794-e22c2dac1e68" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-17cb05c3-dbec-4c07-9794-e22c2dac1e68" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de2968-c190-4855-bcc3-b9e150e5eda7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:44 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68
Jun 15 04:22:44 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:44 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:44 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 0.976s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.824s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:22:44 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe
Jun 15 04:22:44 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d30140e0-f1a6-4554-962b-8b984628e6f3 tempest-VolumesGetTest-914961845 None] Lock "cinder-df4cbd8c-4d6f-4385-b19c-e22e1b160d6a-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:45 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68" returned: 0 in 0.968s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:45 devstack sudo[99310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68
Jun 15 04:22:45 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:45 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe" returned: 0 in 0.822s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:45 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe
Jun 15 04:22:45 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:46 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17cb05c3-dbec-4c07-9794-e22c2dac1e68" returned: 0 in 1.048s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-17cb05c3-dbec-4c07-9794-e22c2dac1e68" released by "delete_volume" :: held 2.078s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Created reservations ['4182e0bd-07b9-4129-a166-6014ac48ca14', '3f308cd7-abe3-4088-9bb3-28788b91637e', 'a06d4843-a665-4523-8bfd-08512305926b', 'edd0c623-16c7-420e-9775-7c7ffd5869b7'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:46 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e.e0904fc6-d0c3-48b4-8741-56ab0824ebfe" returned: 0 in 1.291s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-e0904fc6-d0c3-48b4-8741-56ab0824ebfe" released by "_delete_snapshot" :: held 4.230s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-69656771-fa64-444b-b821-e2e83e47900e" released by "delete_snapshot" :: held 4.273s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:46 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:46 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:46 devstack cinder-volume[92103]: WARNING cinder.quota [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2042757090 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2042757090, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:22:46 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['c339b43a-f914-4d6a-8d76-d50cbb788552', 'f336816d-33ae-49d8-9a78-4fd0f1c7df90', 'af96ed81-db8f-4fa3-9045-def366efb063', '3f5bba13-bef6-4a24-b460-c5f8ea49b5a2'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-164dd75e-0191-4534-8628-098cb3d72b08 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot b398e593-bbd1-4d53-ad17-9bd2b5292203: deleted successfully
Jun 15 04:22:47 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.900s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-b055c2d2-0d71-4edf-8851-69fac3bc2ded-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Lock "cinder-b055c2d2-0d71-4edf-8851-69fac3bc2ded-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ca87190d-573b-4618-8cb3-e0aced62b282 tempest-VolumesGetTest-914961845 None] Lock "cinder-17cb05c3-dbec-4c07-9794-e22c2dac1e68-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-b055c2d2-0d71-4edf-8851-69fac3bc2ded" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-b055c2d2-0d71-4edf-8851-69fac3bc2ded" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de0696-9adf-447f-b2ac-7b5a646a6dd8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:47 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:47 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-69656771-fa64-444b-b821-e2e83e47900e" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:22:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-69656771-fa64-444b-b821-e2e83e47900e" acquired by "delete_volume" :: waited 0.043s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:22:48 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3aa90-33b2-43d4-8eb5-59d2c4aaa4a0]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:48 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:48 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:48 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.990s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:48 devstack sudo[99434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded
Jun 15 04:22:48 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:49 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 1.037s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:49 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e
Jun 15 04:22:49 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:49 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b055c2d2-0d71-4edf-8851-69fac3bc2ded" returned: 0 in 0.881s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-b055c2d2-0d71-4edf-8851-69fac3bc2ded" released by "delete_volume" :: held 1.950s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Created reservations ['92f171fa-a10c-4690-b531-d0bf084729ff', '1e36b23a-e977-4acc-9692-dd99b6adda70', 'b9792a79-0183-4d22-beae-13c3cbdec10c', 'c3051153-790e-4525-9514-75a2c644efcf'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:49 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:49 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:50 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69656771-fa64-444b-b821-e2e83e47900e" returned: 0 in 0.831s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-69656771-fa64-444b-b821-e2e83e47900e" released by "delete_volume" :: held 1.999s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['3fbc51a9-ee54-48b6-a65e-7265b85e146d'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:50 devstack cinder-volume[92103]: WARNING cinder.db.sqlalchemy.api [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2042757090']
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['0a9e95d8-5857-45b2-a2bb-def5c3146aa2', '494e477b-c566-40a3-8fa3-302d839a991a', '2f18fc52-78a9-484c-b13a-21c7f3541600', '906c2c0a-d703-40e4-81a5-5fe13fff74e4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:50 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:22:50 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:50 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.020s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (3f04d193-db6e-44a0-b986-f1849affa71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f36884f-faa9-4a35-a873-2729a2d472da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af671d11-9a8e-48ca-9e59-45d8c632f8cf tempest-VolumesGetTest-914961845 None] Lock "cinder-b055c2d2-0d71-4edf-8851-69fac3bc2ded-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f36884f-faa9-4a35-a873-2729a2d472da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1640590191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5767742-b47f-422b-b3c9-ba7ed509d6c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:51Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2748157-76b3-44f3-9098-f7bdd95c384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2748157-76b3-44f3-9098-f7bdd95c384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b775d03-d6ce-4cae-932c-de68dff953fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:50 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:22:51 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.730s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:22:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-65191b5e-5110-421e-b12a-079551c89958 tempest-GroupSnapshotsTest-1703780758 None] Delete group completed successfully.
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b775d03-d6ce-4cae-932c-de68dff953fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5767742-b47f-422b-b3c9-ba7ed509d6c2', 'volume_name': 'volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdac0710>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8655f072-953d-4dc2-88e4-7f62fc6932bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8655f072-953d-4dc2-88e4-7f62fc6932bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2337531-f182-48fb-9c3d-e6c027fbfcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:51 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Volume c5767742-b47f-422b-b3c9-ba7ed509d6c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdac0710>}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Trying to clone c5767742-b47f-422b-b3c9-ba7ed509d6c2 from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:22:51 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e72919b-e248-4831-85de-5445f07be01c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:52 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD
Jun 15 04:22:52 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-86c24db7-00dc-4780-9ef8-08d44719b025 tempest-GroupSnapshotsTest-1703780758 None] Group tempest-GroupSnapshotsTest-Group-1143533786: creating
Jun 15 04:22:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-86c24db7-00dc-4780-9ef8-08d44719b025 tempest-GroupSnapshotsTest-1703780758 None] Group tempest-GroupSnapshotsTest-Group-1143533786: created successfully
Jun 15 04:22:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-86c24db7-00dc-4780-9ef8-08d44719b025 tempest-GroupSnapshotsTest-1703780758 None] Create group completed successfully.
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Flow 'volume_create_manager' (805fd3cd-13be-4bf5-b0f1-ee473e58ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a186aac-75a9-4c85-9b95-acdb21f5bccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a186aac-75a9-4c85-9b95-acdb21f5bccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1651642802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002a87ea-878d-40e5-8c1f-5604b3a7682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cae7a265de41e1bef836e74ada3b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:53Z,use_quota=True,user_id='6e42802294a74329bdc1d5f3e19b4cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac317f9-4601-4f32-9f5b-de2808f0a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac317f9-4601-4f32-9f5b-de2808f0a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fa792d-3605-4176-a348-a0e511a67a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fa792d-3605-4176-a348-a0e511a67a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002a87ea-878d-40e5-8c1f-5604b3a7682f', 'volume_name': 'volume-002a87ea-878d-40e5-8c1f-5604b3a7682f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78da903-bafa-4b93-b9b7-64c35d30fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78da903-bafa-4b93-b9b7-64c35d30fe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6d7235-cb1a-40f1-8882-250a96958562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:52 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Volume 002a87ea-878d-40e5-8c1f-5604b3a7682f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002a87ea-878d-40e5-8c1f-5604b3a7682f', 'volume_size': 1}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1651642802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002a87ea-878d-40e5-8c1f-5604b3a7682f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cae7a265de41e1bef836e74ada3b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:53Z,use_quota=True,user_id='6e42802294a74329bdc1d5f3e19b4cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Creating volume 002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:52 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:52 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f 1073741824
Jun 15 04:22:52 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:52 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde is fetched for user 78da748538614386a54aa01da6efad50. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3806722-c64d-4639-8871-06879d32c62a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:53 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD
Jun 15 04:22:53 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:53 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f 1073741824" returned: 0 in 0.895s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:53 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:53 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f
Jun 15 04:22:53 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (23494f2f-1d56-4407-88d5-ac4212cdf733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8da8c9-bbba-4e3a-821a-654808097d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8da8c9-bbba-4e3a-821a-654808097d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-737344549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f9afdf5f-e63b-4520-8099-80361f7df929,host='devstack@QuobyteHD#QuobyteHD',id=95c393af-445a-4c0f-908e-47e98dc9cfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:54Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe48bbb9-4b6d-4001-a16c-dad3f4614360),volume_type_id=fe48bbb9-4b6d-4001-a16c-dad3f4614360)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f04e2d8-0b9b-4596-b9a7-fefb30591444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f04e2d8-0b9b-4596-b9a7-fefb30591444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6600bd-cda7-46e4-9b26-3601e2552020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6600bd-cda7-46e4-9b26-3601e2552020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c393af-445a-4c0f-908e-47e98dc9cfc3', 'volume_name': 'volume-95c393af-445a-4c0f-908e-47e98dc9cfc3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eda4184-328e-4696-a1ee-74ef73162ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eda4184-328e-4696-a1ee-74ef73162ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4386f968-fd1e-4fc4-a046-1ef2d4882602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:54 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Volume 95c393af-445a-4c0f-908e-47e98dc9cfc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c393af-445a-4c0f-908e-47e98dc9cfc3', 'volume_size': 1}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:54 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f" returned: 0 in 0.607s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1640590191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5767742-b47f-422b-b3c9-ba7ed509d6c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:51Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Creating volume c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:54 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6d7235-cb1a-40f1-8882-250a96958562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002a87ea-878d-40e5-8c1f-5604b3a7682f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:54 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 1073741824
Jun 15 04:22:54 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f18eec5-9746-4997-bb41-63c72bba830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:54 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Volume volume-002a87ea-878d-40e5-8c1f-5604b3a7682f (002a87ea-878d-40e5-8c1f-5604b3a7682f): created successfully
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f18eec5-9746-4997-bb41-63c72bba830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Flow 'volume_create_manager' (805fd3cd-13be-4bf5-b0f1-ee473e58ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f0567311-a326-4c11-bbae-ed17e5999c5a tempest-SnapshotMetadataTestJSON-540719866 None] Created volume successfully.
Jun 15 04:22:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:55 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 1073741824" returned: 0 in 0.887s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:55 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:22:55 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:55 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 0 in 0.614s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f9afdf5f-e63b-4520-8099-80361f7df929,created_at=2026-06-15T02:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-737344549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f9afdf5f-e63b-4520-8099-80361f7df929,host='devstack@QuobyteHD#QuobyteHD',id=95c393af-445a-4c0f-908e-47e98dc9cfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:54Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe48bbb9-4b6d-4001-a16c-dad3f4614360),volume_type_id=fe48bbb9-4b6d-4001-a16c-dad3f4614360)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Creating volume 95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:22:55 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:55 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 1073741824
Jun 15 04:22:55 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Attempting download of 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume c5767742-b47f-422b-b3c9-ba7ed509d6c2. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef5318-e335-407c-8bbb-fc114a41f626]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:56 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w
Jun 15 04:22:56 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:56 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w" returned: 0 in 0.743s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:56 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 1073741824" returned: 0 in 0.895s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:56 devstack sudo[99494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w
Jun 15 04:22:56 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:56 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3
Jun 15 04:22:56 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:57 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w" returned: 1 in 0.810s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_t2miei6w' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a16350-6965-487c-9b28-f7916acefddf]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:57 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3" returned: 0 in 0.796s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.619s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4386f968-fd1e-4fc4-a046-1ef2d4882602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c393af-445a-4c0f-908e-47e98dc9cfc3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:57 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD
Jun 15 04:22:57 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec765c7-1fad-4ab6-8f7b-7cb060d613af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Creating offline snapshot ab4d944d-7651-4d6e-90be-9c27a164237f of volume 002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:22:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Volume volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 (95c393af-445a-4c0f-908e-47e98dc9cfc3): created successfully
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec765c7-1fad-4ab6-8f7b-7cb060d613af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (23494f2f-1d56-4407-88d5-ac4212cdf733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b615c5-6e27-4207-8baa-783665e10f3e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:22:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3a058ccc-0fe2-4fb5-b132-50122f12ce0b tempest-GroupSnapshotsTest-1703780758 None] Created volume successfully.
Jun 15 04:22:57 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f
Jun 15 04:22:57 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:58 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:58 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] 0ad3d500-cd6a-4357-9bcb-50810aab8cde was qcow2, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:22:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:58 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:22:58 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:58 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f" returned: 0 in 0.835s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:58 devstack sudo[99519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f 1G
Jun 15 04:22:58 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (68d48edd-6060-4351-a837-832d40611a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4166df5e-3fe5-4d9b-b829-71449c948d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4166df5e-3fe5-4d9b-b829-71449c948d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166073871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f9afdf5f-e63b-4520-8099-80361f7df929,host='devstack@QuobyteHD#QuobyteHD',id=1c945385-fd55-4955-ace5-5e70074f7940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:59Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe48bbb9-4b6d-4001-a16c-dad3f4614360),volume_type_id=fe48bbb9-4b6d-4001-a16c-dad3f4614360)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd17aa8d-c1c2-416f-ac0b-e9f8d41c960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd17aa8d-c1c2-416f-ac0b-e9f8d41c960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a7f77f-50a8-49cc-a177-7cf308ac2c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a7f77f-50a8-49cc-a177-7cf308ac2c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c945385-fd55-4955-ace5-5e70074f7940', 'volume_name': 'volume-1c945385-fd55-4955-ace5-5e70074f7940', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd11350c-7549-41bb-a3ec-50097043799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd11350c-7549-41bb-a3ec-50097043799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c89b4-8100-4040-a06e-aab069d9832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:22:59 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Volume 1c945385-fd55-4955-ace5-5e70074f7940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c945385-fd55-4955-ace5-5e70074f7940', 'volume_size': 1}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:22:59 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f 1G" returned: 0 in 1.098s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:22:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002a87ea-878d-40e5-8c1f-5604b3a7682f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:22:59 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002a87ea-878d-40e5-8c1f-5604b3a7682f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f
Jun 15 04:22:59 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:00 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-002a87ea-878d-40e5-8c1f-5604b3a7682f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f" returned: 0 in 0.790s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:00 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f is being set with open permissions: ugo+rw
Jun 15 04:23:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:00 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f
Jun 15 04:23:00 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:00 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 0 in 2.267s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:00 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde__7stoinzdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:23:00 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Converted 112.00 MB image at 49.33 MB/s
Jun 15 04:23:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:00 devstack sudo[99541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 1G
Jun 15 04:23:00 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:01 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f" returned: 0 in 0.613s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:01 devstack sudo[99548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info
Jun 15 04:23:01 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:01 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 1G" returned: 0 in 0.759s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15c54b-b549-483c-b31c-4ffd958ec00a]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:01 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:23:01 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:01 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info" returned: 0 in 0.668s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:01 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info is being set with open permissions: ugo+rw
Jun 15 04:23:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:01 devstack sudo[99554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info
Jun 15 04:23:01 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:02 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 0 in 0.694s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:02 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:23:02 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:02 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.info" returned: 0 in 0.610s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.789s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.251s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f9afdf5f-e63b-4520-8099-80361f7df929,created_at=2026-06-15T02:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166073871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f9afdf5f-e63b-4520-8099-80361f7df929,host='devstack@QuobyteHD#QuobyteHD',id=1c945385-fd55-4955-ace5-5e70074f7940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:22:59Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe48bbb9-4b6d-4001-a16c-dad3f4614360),volume_type_id=fe48bbb9-4b6d-4001-a16c-dad3f4614360)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Creating volume 1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:02 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:02 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 1073741824
Jun 15 04:23:02 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c0d30a87-6542-4ac5-bdc0-051415adf4af tempest-SnapshotMetadataTestJSON-540719866 None] Create snapshot completed successfully
Jun 15 04:23:02 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 1 in 0.726s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Downloaded image 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume c5767742-b47f-422b-b3c9-ba7ed509d6c2 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde for user 78da748538614386a54aa01da6efad50 is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Marking volume c5767742-b47f-422b-b3c9-ba7ed509d6c2 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Copying metadata from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde to c5767742-b47f-422b-b3c9-ba7ed509d6c2. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Creating volume glance metadata for volume c5767742-b47f-422b-b3c9-ba7ed509d6c2 backed by image 0ad3d500-cd6a-4357-9bcb-50810aab8cde with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2337531-f182-48fb-9c3d-e6c027fbfcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdac0710>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e33c86b-03ba-4939-8763-344e27423ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Volume volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 (c5767742-b47f-422b-b3c9-ba7ed509d6c2): created successfully
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e33c86b-03ba-4939-8763-344e27423ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (3f04d193-db6e-44a0-b986-f1849affa71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c28619db-2318-4a7b-be14-25d2af2669cf tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:23:03 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 1073741824" returned: 0 in 0.762s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:03 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940
Jun 15 04:23:03 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:03 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940" returned: 0 in 0.626s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c89b4-8100-4040-a06e-aab069d9832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c945385-fd55-4955-ace5-5e70074f7940', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596cd53-f6c7-4a13-823a-29dc6f3bd0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Volume volume-1c945385-fd55-4955-ace5-5e70074f7940 (1c945385-fd55-4955-ace5-5e70074f7940): created successfully
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596cd53-f6c7-4a13-823a-29dc6f3bd0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (68d48edd-6060-4351-a837-832d40611a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:03 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d33492fc-f22d-42c1-8726-09cefdffcda7 tempest-GroupSnapshotsTest-1703780758 None] Created volume successfully.
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b732a-554a-40e6-9c53-f39cd2d9e366]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:04 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194
Jun 15 04:23:04 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "cinder-ab4d944d-7651-4d6e-90be-9c27a164237f-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-ab4d944d-7651-4d6e-90be-9c27a164237f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "cinder-quobyte-002a87ea-878d-40e5-8c1f-5604b3a7682f" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-quobyte-002a87ea-878d-40e5-8c1f-5604b3a7682f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "cinder-quobyte-ab4d944d-7651-4d6e-90be-9c27a164237f" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-quobyte-ab4d944d-7651-4d6e-90be-9c27a164237f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Deleting offline snapshot ab4d944d-7651-4d6e-90be-9c27a164237f of volume 002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] snapshot_file for this snap is: volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3fde21-0986-41d9-b6ea-17725967df65]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:04 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f
Jun 15 04:23:04 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (fad9a0ab-7d5f-4b06-9fec-c842771e7044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fb4c7e-94cf-441d-9ed0-300d893b92b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fb4c7e-94cf-441d-9ed0-300d893b92b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-501185307',display_name='tempest-VolumesGetTest-Volume-329578292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b47b10-1e03-408e-8b2a-800d87a861da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:05Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12fbf57-a5be-4d60-aef2-d358c2a96a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12fbf57-a5be-4d60-aef2-d358c2a96a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e05bce2-09cc-450f-b430-92bc3e67165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e05bce2-09cc-450f-b430-92bc3e67165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b47b10-1e03-408e-8b2a-800d87a861da', 'volume_name': 'volume-87b47b10-1e03-408e-8b2a-800d87a861da', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e42b559-77f5-4dd0-b244-f3eeca5c94e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e42b559-77f5-4dd0-b244-f3eeca5c94e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb3069a-a644-496f-8117-dddb6cde6add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Volume 87b47b10-1e03-408e-8b2a-800d87a861da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b47b10-1e03-408e-8b2a-800d87a861da', 'volume_size': 1}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:04 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-41300670-da01-4000-967e-dc8d2ea0158b tempest-GroupSnapshotsTest-1703780758 None] Update group completed successfully.
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194" returned: 0 in 0.826s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-501185307',display_name='tempest-VolumesGetTest-Volume-329578292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b47b10-1e03-408e-8b2a-800d87a861da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cc544b42db44dd890d639c9e4594cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:05Z,use_quota=True,user_id='78da748538614386a54aa01da6efad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Creating volume 87b47b10-1e03-408e-8b2a-800d87a861da {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:04 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:04 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da 1073741824
Jun 15 04:23:05 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-a46b0729-84f1-4930-a726-eeca7b676194', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '695dbe00-cf4e-4ec9-b3a3-71707add5e5e', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:23:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-8d66bf4d-d96d-4664-bf57-99838dcfe968 req-9a8b050b-fe8d-4b52-9b8f-6ea3987a383c tempest-AttachVolumeShelveTestJSON-2068040000 None] attachment_update completed successfully.
Jun 15 04:23:05 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f" returned: 0 in 0.818s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-002a87ea-878d-40e5-8c1f-5604b3a7682f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d3d9d-15cc-4f56-9e5b-c95d7ef3c67c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:05 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f
Jun 15 04:23:05 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:05 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da 1073741824" returned: 0 in 0.849s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:05 devstack sudo[99600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da
Jun 15 04:23:05 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:05 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f" returned: 0 in 0.778s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:06 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f
Jun 15 04:23:06 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9bdb8a88-55eb-47ee-89c0-309850d2a5bf tempest-GroupSnapshotsTest-1703780758 None] Update group completed successfully.
Jun 15 04:23:06 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da" returned: 0 in 0.653s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb3069a-a644-496f-8117-dddb6cde6add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b47b10-1e03-408e-8b2a-800d87a861da', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c734fb-168c-452a-9cd6-c83f23f391d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:06 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Volume volume-87b47b10-1e03-408e-8b2a-800d87a861da (87b47b10-1e03-408e-8b2a-800d87a861da): created successfully
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c734fb-168c-452a-9cd6-c83f23f391d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Flow 'volume_create_manager' (fad9a0ab-7d5f-4b06-9fec-c842771e7044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3fe60d96-48cf-4a9e-b69d-1c2451002ab2 tempest-VolumesGetTest-914961845 None] Created volume successfully.
Jun 15 04:23:06 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f" returned: 0 in 0.754s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:06 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f
Jun 15 04:23:06 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-87b47b10-1e03-408e-8b2a-800d87a861da-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Lock "cinder-87b47b10-1e03-408e-8b2a-800d87a861da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-87b47b10-1e03-408e-8b2a-800d87a861da" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-87b47b10-1e03-408e-8b2a-800d87a861da" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ca853-ba9e-4821-8bbb-35ad079cbaa1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-539d458b-14c3-4401-a012-5b0a15a54f74 tempest-GroupSnapshotsTest-1703780758 None] Update group completed successfully.
Jun 15 04:23:07 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da
Jun 15 04:23:07 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:07 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f.ab4d944d-7651-4d6e-90be-9c27a164237f" returned: 0 in 0.628s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-quobyte-ab4d944d-7651-4d6e-90be-9c27a164237f" released by "_delete_snapshot" :: held 3.096s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-quobyte-002a87ea-878d-40e5-8c1f-5604b3a7682f" released by "delete_snapshot" :: held 3.119s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Created reservations ['9c198cba-7b69-43a9-9e46-9b18cd3960cb', '72894b6b-a3a0-4426-a6e2-dfd465fda8e6', '6737fdbf-3eb3-4dde-8048-b274b72358c0', '787142b7-83c0-4628-b447-b7af4f190336'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Delete snapshot completed successfully.
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ac2b5435-37bd-41be-af74-3976c52d5af6 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-ab4d944d-7651-4d6e-90be-9c27a164237f-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "cinder-002a87ea-878d-40e5-8c1f-5604b3a7682f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-002a87ea-878d-40e5-8c1f-5604b3a7682f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "cinder-quobyte-002a87ea-878d-40e5-8c1f-5604b3a7682f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-quobyte-002a87ea-878d-40e5-8c1f-5604b3a7682f" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb845a3-072f-4a09-b099-ff7f2a5f439b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:07 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da" returned: 0 in 0.806s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:08 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da
Jun 15 04:23:08 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:08 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f
Jun 15 04:23:08 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-603b0f38-fb16-40ba-b887-1db69a40bc25 tempest-GroupSnapshotsTest-1703780758 None] Update group completed successfully.
Jun 15 04:23:08 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-87b47b10-1e03-408e-8b2a-800d87a861da" returned: 0 in 0.658s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:08 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-87b47b10-1e03-408e-8b2a-800d87a861da" released by "delete_volume" :: held 1.520s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f" returned: 0 in 0.725s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:08 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f
Jun 15 04:23:08 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Created reservations ['cd3e7455-26a2-462c-b7da-6235bf770b52', '5496407a-b4c0-453b-84b4-3054ed8e8288', 'fff06cf3-dda2-49dc-b01a-f652d3fa9807', 'c3c8053c-3500-482d-9981-bf2f7f0b3653'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:08 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:08 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:09 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-002a87ea-878d-40e5-8c1f-5604b3a7682f" returned: 0 in 0.656s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-c5767742-b47f-422b-b3c9-ba7ed509d6c2-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-quobyte-002a87ea-878d-40e5-8c1f-5604b3a7682f" released by "delete_volume" :: held 1.451s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Lock "cinder-c5767742-b47f-422b-b3c9-ba7ed509d6c2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Created reservations ['8e9e83bf-e7a5-4395-9d88-890d05e979fe', 'c3a1a184-ca06-4e68-b060-06dd3cfabf2f', 'ce023e78-4fd7-4d9f-bbf3-00707ae98806', '71d4d14b-80c8-4e79-8025-6030f8b1cab4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:09 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Acquiring lock "cinder-quobyte-c5767742-b47f-422b-b3c9-ba7ed509d6c2" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.667s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:09 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-c5767742-b47f-422b-b3c9-ba7ed509d6c2" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6eccc38c-28dd-48a5-81f6-983aa0458eee tempest-VolumesGetTest-914961845 None] Lock "cinder-87b47b10-1e03-408e-8b2a-800d87a861da-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c08a127-0043-474f-a3d4-7e760d0701d2]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:09 devstack sudo[99633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:09 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:09 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:23:09 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:09 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] GroupSnapshot 90746a8c-c41e-443f-a485-4d82e66b41e9: creating.
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Group snapshot 90746a8c-c41e-443f-a485-4d82e66b41e9: creating. {{(pid=92103) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Creating offline snapshot 0bfd391a-d466-4b54-9c0b-39e4b6150cc2 of volume 95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f571d7-8404-4237-8bfa-fdd43ef86216]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:10 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3
Jun 15 04:23:10 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:10 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.998s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:10 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Deleted volume successfully.
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-029adc71-0eaa-44b9-b789-3b8c517f5be4 tempest-SnapshotMetadataTestJSON-540719866 None] Lock "cinder-002a87ea-878d-40e5-8c1f-5604b3a7682f-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:10 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 0 in 1.287s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:10 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:23:10 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:10 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3" returned: 0 in 0.955s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:11 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 1G
Jun 15 04:23:11 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:11 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 1 in 0.870s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:23:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:11 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2
Jun 15 04:23:11 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:12 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 1G" returned: 0 in 1.086s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:12 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2
Jun 15 04:23:12 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:12 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c5767742-b47f-422b-b3c9-ba7ed509d6c2" returned: 0 in 0.789s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Lock "cinder-quobyte-c5767742-b47f-422b-b3c9-ba7ed509d6c2" released by "delete_volume" :: held 3.038s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Created reservations ['30d7414d-0574-45e5-8efe-bb20c88344d1', 'b2d678da-d00c-4735-b1ec-2a1330ae778b', '07a302b3-e9f7-42ee-8d35-015fd23b3764', '18bf8191-8962-4762-95b7-b7a0e80f6805'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:12 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:12 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:12 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2" returned: 0 in 0.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:12 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:23:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:12 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2
Jun 15 04:23:12 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:13 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.738s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:13 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Deleted volume successfully.
Jun 15 04:23:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a39bd98f-08b4-410e-a2fb-03dbcf9046fb tempest-VolumesGetTest-914961845 None] Lock "cinder-c5767742-b47f-422b-b3c9-ba7ed509d6c2-delete_volume" released by "delete_volume" :: held 4.068s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:13 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2" returned: 0 in 0.829s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:13 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info
Jun 15 04:23:13 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:14 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info" returned: 0 in 0.795s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:14 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:23:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:14 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info
Jun 15 04:23:14 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:15 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.info" returned: 0 in 1.049s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.608s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Creating offline snapshot 86a3c655-e86e-4606-a133-79d414ca5c29 of volume 1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a6bbe0-d0d5-4791-875c-fc9e134db560]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:15 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940
Jun 15 04:23:15 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:15 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Flow 'volume_create_manager' (aabd6041-807f-493b-996d-e6d4003c4969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf8f1a6-3542-4861-b01a-ca4fcefe9543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf8f1a6-3542-4861-b01a-ca4fcefe9543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1222898451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc74673-c55e-4759-98be-5540e710ed47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcc7ea296d14edc9d57d4f3465025b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:16Z,use_quota=True,user_id='13ee27417614496cab8646c1ad684923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582a53b1-529e-4b22-acbf-577e483eb510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582a53b1-529e-4b22-acbf-577e483eb510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9c5bd-7f35-4e4a-bb4e-01bbe2101908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9c5bd-7f35-4e4a-bb4e-01bbe2101908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc74673-c55e-4759-98be-5540e710ed47', 'volume_name': 'volume-fcc74673-c55e-4759-98be-5540e710ed47', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b2254b-13a3-417e-8329-6de51521ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b2254b-13a3-417e-8329-6de51521ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ff0ab8-7a6f-475b-8fc0-1c4d91b31068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:16 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Volume fcc74673-c55e-4759-98be-5540e710ed47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc74673-c55e-4759-98be-5540e710ed47', 'volume_size': 1}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:16 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940" returned: 0 in 0.877s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:16 devstack sudo[99708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 1G
Jun 15 04:23:16 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:17 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 1G" returned: 0 in 0.840s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c945385-fd55-4955-ace5-5e70074f7940 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:17 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c945385-fd55-4955-ace5-5e70074f7940 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29
Jun 15 04:23:17 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:18 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c945385-fd55-4955-ace5-5e70074f7940 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29" returned: 0 in 0.883s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:18 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:23:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:18 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29
Jun 15 04:23:18 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:18 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29" returned: 0 in 0.620s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:18 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info
Jun 15 04:23:18 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:19 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info" returned: 0 in 0.651s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:19 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:23:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:19 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info
Jun 15 04:23:19 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:20 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.info" returned: 0 in 0.585s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.553s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.056s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1222898451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc74673-c55e-4759-98be-5540e710ed47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcc7ea296d14edc9d57d4f3465025b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:16Z,use_quota=True,user_id='13ee27417614496cab8646c1ad684923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Creating volume fcc74673-c55e-4759-98be-5540e710ed47 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:20 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:20 devstack sudo[99805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47 1073741824
Jun 15 04:23:20 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7ff74fc4-49f1-4b66-8ac1-568a5ea7537c tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 90746a8c-c41e-443f-a485-4d82e66b41e9: created successfully
Jun 15 04:23:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 90746a8c-c41e-443f-a485-4d82e66b41e9: deleting
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 90746a8c-c41e-443f-a485-4d82e66b41e9: deleting {{(pid=92103) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-95c393af-445a-4c0f-908e-47e98dc9cfc3" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-95c393af-445a-4c0f-908e-47e98dc9cfc3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-0bfd391a-d466-4b54-9c0b-39e4b6150cc2" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-0bfd391a-d466-4b54-9c0b-39e4b6150cc2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Deleting offline snapshot 0bfd391a-d466-4b54-9c0b-39e4b6150cc2 of volume 95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] snapshot_file for this snap is: volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34c57cf-588f-464f-b3f9-176f43fd6ca7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:20 devstack sudo[99813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2
Jun 15 04:23:20 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:21 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47 1073741824" returned: 0 in 0.977s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:21 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47
Jun 15 04:23:21 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:21 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2" returned: 0 in 0.886s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c393af-445a-4c0f-908e-47e98dc9cfc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb0d52a-cc7f-4ed5-8f2d-f5d6eb39de63]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:21 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3
Jun 15 04:23:21 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:21 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47" returned: 0 in 0.790s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ff0ab8-7a6f-475b-8fc0-1c4d91b31068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc74673-c55e-4759-98be-5540e710ed47', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7fc042-f833-4408-b6b2-ffa6b2102733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Volume volume-fcc74673-c55e-4759-98be-5540e710ed47 (fcc74673-c55e-4759-98be-5540e710ed47): created successfully
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7fc042-f833-4408-b6b2-ffa6b2102733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Flow 'volume_create_manager' (aabd6041-807f-493b-996d-e6d4003c4969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:22 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5ac37dad-d447-4d07-8d59-424e9ecb6eaa tempest-VolumesTransfersV355Test-837601272 None] Created volume successfully.
Jun 15 04:23:22 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3" returned: 0 in 1.016s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:22 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2
Jun 15 04:23:22 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3e5abcfd-d5ee-4e5e-a06c-7598ffc88755 tempest-VolumesTransfersV355Test-692500964 None] Transfer volume completed successfully.
Jun 15 04:23:24 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2" returned: 0 in 1.607s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:24 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2
Jun 15 04:23:24 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:25 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3.0bfd391a-d466-4b54-9c0b-39e4b6150cc2" returned: 0 in 1.038s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-0bfd391a-d466-4b54-9c0b-39e4b6150cc2" released by "_delete_snapshot" :: held 4.714s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-95c393af-445a-4c0f-908e-47e98dc9cfc3" released by "delete_snapshot" :: held 4.751s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=112,cinder:INSERT=41,cinder:DELETE=8,cinder:SELECT=129 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-1c945385-fd55-4955-ace5-5e70074f7940" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-1c945385-fd55-4955-ace5-5e70074f7940" acquired by "delete_snapshot" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-86a3c655-e86e-4606-a133-79d414ca5c29" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-86a3c655-e86e-4606-a133-79d414ca5c29" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Deleting offline snapshot 86a3c655-e86e-4606-a133-79d414ca5c29 of volume 1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] snapshot_file for this snap is: volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4098cb1-c487-4918-95e2-db02217e22d8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:25 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29
Jun 15 04:23:25 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Acquiring lock "cinder-fcc74673-c55e-4759-98be-5540e710ed47-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-fcc74673-c55e-4759-98be-5540e710ed47-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=154,cinder:SELECT=115,cinder:INSERT=31,cinder:DELETE=10 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Acquiring lock "cinder-quobyte-fcc74673-c55e-4759-98be-5540e710ed47" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-quobyte-fcc74673-c55e-4759-98be-5540e710ed47" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d868a-b032-4006-b48e-38ca504e0927]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:26 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47
Jun 15 04:23:26 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:27 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29" returned: 0 in 1.384s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c945385-fd55-4955-ace5-5e70074f7940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:23:27 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b701cb50-1671-4341-a05e-aaa599d15122]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:27 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940
Jun 15 04:23:27 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:27 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47" returned: 0 in 1.275s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:27 devstack sudo[100239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47
Jun 15 04:23:27 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:28 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940" returned: 0 in 1.443s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:28 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29
Jun 15 04:23:28 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:28 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fcc74673-c55e-4759-98be-5540e710ed47" returned: 0 in 1.088s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-quobyte-fcc74673-c55e-4759-98be-5540e710ed47" released by "delete_volume" :: held 2.446s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Created reservations ['fb7b6a1e-7026-4779-8868-1ae9605026c3', '8be76bf2-a067-44be-ab1f-4b38b4504463', '5dc26c8d-1b40-453e-a9f9-c9e2de609278', '9dc0ff8d-1799-4d58-877d-a1adfbbf5f14'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:28 devstack sudo[100247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:28 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:29 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29" returned: 0 in 0.975s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:29 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29
Jun 15 04:23:29 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:29 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:29 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Deleted volume successfully.
Jun 15 04:23:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec8abd5a-6e7c-4b11-9723-bc35cf80d24e tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-fcc74673-c55e-4759-98be-5540e710ed47-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Flow 'volume_create_manager' (315074bf-bb40-4d5f-add9-0c6cfd2eaa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef2085a-b3de-4ee4-b3fc-b11d9e2c0afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef2085a-b3de-4ee4-b3fc-b11d9e2c0afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-679210087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ef7829-f038-472c-a9f4-e7cbba1ef24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcc7ea296d14edc9d57d4f3465025b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:30Z,use_quota=True,user_id='13ee27417614496cab8646c1ad684923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799c7ea9-7348-46fb-93b6-c0117727042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799c7ea9-7348-46fb-93b6-c0117727042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7c4758-cf07-453b-85aa-362ececbf532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7c4758-cf07-453b-85aa-362ececbf532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ef7829-f038-472c-a9f4-e7cbba1ef24d', 'volume_name': 'volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d835b12-8c1a-45f7-b1c9-5fcf340d7552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d835b12-8c1a-45f7-b1c9-5fcf340d7552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6325d555-f1ca-4aa0-b81d-ba627eab64b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Volume b5ef7829-f038-472c-a9f4-e7cbba1ef24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d', 'volume_size': 1}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-679210087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ef7829-f038-472c-a9f4-e7cbba1ef24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcc7ea296d14edc9d57d4f3465025b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:30Z,use_quota=True,user_id='13ee27417614496cab8646c1ad684923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Creating volume b5ef7829-f038-472c-a9f4-e7cbba1ef24d {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:30 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:30 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940.86a3c655-e86e-4606-a133-79d414ca5c29" returned: 0 in 0.974s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:30 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d 1073741824
Jun 15 04:23:30 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-86a3c655-e86e-4606-a133-79d414ca5c29" released by "_delete_snapshot" :: held 4.946s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-1c945385-fd55-4955-ace5-5e70074f7940" released by "delete_snapshot" :: held 4.985s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:30 devstack cinder-volume[92103]: WARNING cinder.quota [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1369168344 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1369168344, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:23:30 devstack cinder-volume[92103]: WARNING cinder.quota [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1369168344 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1369168344, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['ef4094fa-c416-433b-841c-c09bc96a1d41', '956f64cc-e7e1-44c2-bf25-46a71f5a6d35', 'beffd93f-5905-48ef-b1c2-ec4369127614', '6a80bd31-42b7-45e1-a448-062ffb3c2c7f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:30 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['c01c4095-94c5-447b-b6f3-42a3cccff9c7', '76c31616-41a7-47ef-b4c7-23230c74b853', '53ce4b8a-7d26-49ef-ba42-b6e145ef2fb9', 'b4525a4f-03d2-4100-8be0-7ddd4e25b928'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-adf4a300-0e97-4ad5-9408-dbdb9617677b tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 90746a8c-c41e-443f-a485-4d82e66b41e9: deleted successfully
Jun 15 04:23:31 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d 1073741824" returned: 0 in 0.966s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:31 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d
Jun 15 04:23:31 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-1c945385-fd55-4955-ace5-5e70074f7940" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-1c945385-fd55-4955-ace5-5e70074f7940" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee5ee9d-29ac-404d-af96-7629aa6af2f8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:32 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940
Jun 15 04:23:32 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:32 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d" returned: 0 in 0.905s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6325d555-f1ca-4aa0-b81d-ba627eab64b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fcb203-c23d-4f50-b1f4-8cdf361ce310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:32 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Volume volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d (b5ef7829-f038-472c-a9f4-e7cbba1ef24d): created successfully
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fcb203-c23d-4f50-b1f4-8cdf361ce310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Flow 'volume_create_manager' (315074bf-bb40-4d5f-add9-0c6cfd2eaa01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-044eadef-6042-4e9b-8b16-cba315b24561 tempest-VolumesTransfersV355Test-837601272 None] Created volume successfully.
Jun 15 04:23:32 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940" returned: 0 in 0.894s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:32 devstack sudo[100271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940
Jun 15 04:23:32 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:33 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1c945385-fd55-4955-ace5-5e70074f7940" returned: 0 in 0.775s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-1c945385-fd55-4955-ace5-5e70074f7940" released by "delete_volume" :: held 1.761s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-95c393af-445a-4c0f-908e-47e98dc9cfc3" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-95c393af-445a-4c0f-908e-47e98dc9cfc3" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae13e0fa-b7f8-43ab-b8bd-e9a65074d76c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Acquiring lock "cinder-b5ef7829-f038-472c-a9f4-e7cbba1ef24d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-b5ef7829-f038-472c-a9f4-e7cbba1ef24d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Acquiring lock "cinder-quobyte-b5ef7829-f038-472c-a9f4-e7cbba1ef24d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-quobyte-b5ef7829-f038-472c-a9f4-e7cbba1ef24d" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e14a208-b2e0-4be2-abcd-477ef9466469]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:33 devstack sudo[100274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3
Jun 15 04:23:33 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:34 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d
Jun 15 04:23:34 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:34 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d" returned: 0 in 0.926s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:34 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d
Jun 15 04:23:34 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:34 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3" returned: 0 in 1.170s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:35 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3
Jun 15 04:23:35 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:35 devstack sudo[100290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:35 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:36 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-95c393af-445a-4c0f-908e-47e98dc9cfc3" returned: 0 in 1.177s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-95c393af-445a-4c0f-908e-47e98dc9cfc3" released by "delete_volume" :: held 2.433s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:36 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5ef7829-f038-472c-a9f4-e7cbba1ef24d" returned: 0 in 1.380s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-quobyte-b5ef7829-f038-472c-a9f4-e7cbba1ef24d" released by "delete_volume" :: held 2.368s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['ca79c70d-fbcd-48ba-803b-02760ebe62d9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Created reservations ['5a8fa4f8-d981-45ce-b0f6-dc689e1b6f00', '5629830c-b67a-4c81-9382-c8af9e0c7c20', 'da70da42-e88b-446b-8b3d-d11b87bf7b36', '7fdb29eb-d632-4321-964f-b044de19ec42'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:36 devstack cinder-volume[92103]: WARNING cinder.quota [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1369168344 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1369168344, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['ab27e5da-52bf-4f24-ad07-7640ca803e92', 'fc044b78-4808-4e9e-8fac-6bced4a31ef4', 'b18a1358-1b2c-4781-8ce8-1c0d7716a8d0', '9f8d1bbb-8082-49a9-99fc-53f22d162d01'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:36 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:36 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:36 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.141s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['bd9691db-5517-482c-8ca8-faec0fbbfde0', '15d6cd65-c59d-4530-a33f-f5a1b4c457e4', '0ceb88f4-2798-4a58-a79e-ae4efb0d90f4', 'f2fb3f89-9b25-49be-8788-ff42bfe80d1e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:37 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:37 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:37 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.137s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:37 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Deleted volume successfully.
Jun 15 04:23:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a49ac8b7-8b0c-48ad-b909-f919269c50c1 tempest-VolumesTransfersV355Test-1208602134 None] Lock "cinder-b5ef7829-f038-472c-a9f4-e7cbba1ef24d-delete_volume" released by "delete_volume" :: held 3.853s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:37 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.819s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:37 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b484a8c0-e95f-478b-b86a-bca5956668df tempest-GroupSnapshotsTest-1703780758 None] Delete group completed successfully.
Jun 15 04:23:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0608dbbc-9483-465b-8560-58bbd80eae44 tempest-GroupSnapshotsTest-1703780758 None] Group tempest-GroupSnapshotsTest-Group-996841333: creating
Jun 15 04:23:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0608dbbc-9483-465b-8560-58bbd80eae44 tempest-GroupSnapshotsTest-1703780758 None] Group tempest-GroupSnapshotsTest-Group-996841333: created successfully
Jun 15 04:23:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0608dbbc-9483-465b-8560-58bbd80eae44 tempest-GroupSnapshotsTest-1703780758 None] Create group completed successfully.
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (90933aa2-d916-41f9-805b-867335c10a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae095e00-9baf-4b02-8732-efa7f0074eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae095e00-9baf-4b02-8732-efa7f0074eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765474921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c9ccc56-cfdb-46af-9e98-f0d84b58657c,host='devstack@QuobyteHD#QuobyteHD',id=78238d1e-c404-4ec1-ab23-417c87d7f7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:40Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(878cbe25-8b50-42e6-b68d-25f49d0728ed),volume_type_id=878cbe25-8b50-42e6-b68d-25f49d0728ed)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f567644-d037-44f5-8cb8-df3863f4062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f567644-d037-44f5-8cb8-df3863f4062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce71299d-6d1b-4806-a2da-be8af4bca38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce71299d-6d1b-4806-a2da-be8af4bca38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78238d1e-c404-4ec1-ab23-417c87d7f7ce', 'volume_name': 'volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132fb53f-1c0e-449d-a093-2aebfe6b4a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132fb53f-1c0e-449d-a093-2aebfe6b4a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384d900-39a4-422b-96a4-6a4e8b431008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:40 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Volume 78238d1e-c404-4ec1-ab23-417c87d7f7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce', 'volume_size': 1}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7c9ccc56-cfdb-46af-9e98-f0d84b58657c,created_at=2026-06-15T02:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765474921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c9ccc56-cfdb-46af-9e98-f0d84b58657c,host='devstack@QuobyteHD#QuobyteHD',id=78238d1e-c404-4ec1-ab23-417c87d7f7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe9bd0bace24cc4895396f4ce4c5792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:40Z,use_quota=True,user_id='3a639917fc7f4f329da2fd001ec05b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(878cbe25-8b50-42e6-b68d-25f49d0728ed),volume_type_id=878cbe25-8b50-42e6-b68d-25f49d0728ed)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Creating volume 78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:40 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce 1073741824
Jun 15 04:23:40 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:41 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce 1073741824" returned: 0 in 0.938s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:41 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce
Jun 15 04:23:41 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:41 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce" returned: 0 in 0.683s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384d900-39a4-422b-96a4-6a4e8b431008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79ed035-b4a6-4fcf-89ea-0b4db254c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:41 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Volume volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce (78238d1e-c404-4ec1-ab23-417c87d7f7ce): created successfully
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79ed035-b4a6-4fcf-89ea-0b4db254c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Flow 'volume_create_manager' (90933aa2-d916-41f9-805b-867335c10a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-99a70d53-2591-4e5d-8d73-50bb8f4a0ba6 tempest-GroupSnapshotsTest-1703780758 None] Created volume successfully.
Jun 15 04:23:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] GroupSnapshot 621f5bd2-5938-4846-b838-c24b771389d2: creating.
Jun 15 04:23:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Group snapshot 621f5bd2-5938-4846-b838-c24b771389d2: creating. {{(pid=92103) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 04:23:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Creating offline snapshot 339357f1-98ed-4027-a27a-329d25ea9224 of volume 78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:23:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cfece9-5bb0-458a-9b67-f64ed260190d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:42 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce
Jun 15 04:23:42 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:43 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce" returned: 0 in 0.823s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:43 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 1G
Jun 15 04:23:43 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Flow 'volume_create_manager' (88030e67-5025-42c0-9926-e0208d7c492c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c679145-03a4-43bc-8a1f-0898f2cd30c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c679145-03a4-43bc-8a1f-0898f2cd30c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1409252418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6497ba9b-8b45-457d-88b4-71ca9aa0f306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b0bdfe93fe47fc83847e4c66fd99e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:44Z,use_quota=True,user_id='6857518ad6db49dda020a35aae166dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a4eee-8497-4e42-97c9-110ef1aeb01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a4eee-8497-4e42-97c9-110ef1aeb01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e79207-4f2d-49b0-9e7c-530bcabcbce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e79207-4f2d-49b0-9e7c-530bcabcbce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6497ba9b-8b45-457d-88b4-71ca9aa0f306', 'volume_name': 'volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306', 'volume_size': 2}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366eaac7-7f4c-46ca-a261-b8b7f4f30296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366eaac7-7f4c-46ca-a261-b8b7f4f30296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843fb21d-d9c9-43c7-8263-481f65c33ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:43 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Volume 6497ba9b-8b45-457d-88b4-71ca9aa0f306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306', 'volume_size': 2}
Jun 15 04:23:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:44 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 1G" returned: 0 in 0.812s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:44 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224
Jun 15 04:23:44 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:45 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224" returned: 0 in 0.762s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:45 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:23:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:45 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224
Jun 15 04:23:45 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:45 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:45 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info
Jun 15 04:23:45 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:46 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info" returned: 0 in 0.683s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:46 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 04:23:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:46 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info
Jun 15 04:23:46 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:47 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.info" returned: 0 in 0.644s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.342s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1409252418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6497ba9b-8b45-457d-88b4-71ca9aa0f306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b0bdfe93fe47fc83847e4c66fd99e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:44Z,use_quota=True,user_id='6857518ad6db49dda020a35aae166dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Creating volume 6497ba9b-8b45-457d-88b4-71ca9aa0f306 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:47 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 2147483648 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:47 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 2147483648
Jun 15 04:23:47 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Flow 'volume_create_manager' (842f672f-43e2-48ab-9abe-f2ed71437684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df714980-825a-47ba-8b80-e003371ef3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df714980-825a-47ba-8b80-e003371ef3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1881743642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17129a61-4816-45e3-b5d8-cfd4a546bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ccbcdbdd5f34a1ba0385f22d2764653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:47Z,use_quota=True,user_id='7290d50d4b6b4d9f86db2d6d21bfa615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15787d50-028f-4592-8697-af144cff8f18),volume_type_id=15787d50-028f-4592-8697-af144cff8f18)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e041b4bd-c27a-4c0f-a350-5be04f5f3292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e041b4bd-c27a-4c0f-a350-5be04f5f3292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f417782a-1ec0-4ff4-856f-c32960f5b7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f417782a-1ec0-4ff4-856f-c32960f5b7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17129a61-4816-45e3-b5d8-cfd4a546bd35', 'volume_name': 'volume-17129a61-4816-45e3-b5d8-cfd4a546bd35', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5868d65-c742-4769-a186-1df84f75fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5868d65-c742-4769-a186-1df84f75fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cbec39-6219-4547-bcfe-a0944c0dd9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume 17129a61-4816-45e3-b5d8-cfd4a546bd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17129a61-4816-45e3-b5d8-cfd4a546bd35', 'volume_size': 1}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f75fb868-7352-48f4-97cc-a706382737db tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 621f5bd2-5938-4846-b838-c24b771389d2: created successfully
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Flow 'volume_create_manager' (a836d215-396e-4474-be4a-5f3fff9674e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005cfd85-5d40-4dd4-8123-d3db04ca51c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005cfd85-5d40-4dd4-8123-d3db04ca51c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-210174991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d0eafc-3e21-4125-af81-61afbb618171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ccbcdbdd5f34a1ba0385f22d2764653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:47Z,use_quota=True,user_id='7290d50d4b6b4d9f86db2d6d21bfa615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac3f5754-6d25-4b1c-810c-49f105de5186),volume_type_id=ac3f5754-6d25-4b1c-810c-49f105de5186)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059d1216-7705-42d8-b177-69f85a360936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059d1216-7705-42d8-b177-69f85a360936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7290f2f8-3b12-42aa-848f-d3f2a5827c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7290f2f8-3b12-42aa-848f-d3f2a5827c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d0eafc-3e21-4125-af81-61afbb618171', 'volume_name': 'volume-02d0eafc-3e21-4125-af81-61afbb618171', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd2151a-177e-4e55-8f56-b1ac05ab3122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd2151a-177e-4e55-8f56-b1ac05ab3122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c68086-967c-4d84-89d2-dcd331b625ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:47 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume 02d0eafc-3e21-4125-af81-61afbb618171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d0eafc-3e21-4125-af81-61afbb618171', 'volume_size': 1}
Jun 15 04:23:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Flow 'volume_create_manager' (fd157705-986c-4535-96e2-732a5ab146ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8d9b12-477e-4ec1-986d-d1d320ae188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 621f5bd2-5938-4846-b838-c24b771389d2: deleting
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8d9b12-477e-4ec1-986d-d1d320ae188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1418663525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53686a46-44f1-40d7-bdf7-9f3a4ff9036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ccbcdbdd5f34a1ba0385f22d2764653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:48Z,use_quota=True,user_id='7290d50d4b6b4d9f86db2d6d21bfa615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(669b3526-72c5-4eb4-84f7-af5cdca08ea7),volume_type_id=669b3526-72c5-4eb4-84f7-af5cdca08ea7)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f97e5ce-07c3-4e85-bf17-cc1f90a4dceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f97e5ce-07c3-4e85-bf17-cc1f90a4dceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e84a5a1-8b52-401e-8fd0-40269ef80765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:23:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-df84e600-350c-467b-8165-68d26818a0de req-399561eb-91bb-4a13-bb84-4aa181c9ad51 tempest-AttachVolumeShelveTestJSON-2068040000 None] Terminate volume connection completed successfully.
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-df84e600-350c-467b-8165-68d26818a0de req-399561eb-91bb-4a13-bb84-4aa181c9ad51 tempest-AttachVolumeShelveTestJSON-2068040000 None] Deleting attachment 695dbe00-cf4e-4ec9-b3a3-71707add5e5e. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 621f5bd2-5938-4846-b838-c24b771389d2: deleting {{(pid=92103) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 04:23:48 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 2147483648" returned: 0 in 1.259s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-78238d1e-c404-4ec1-ab23-417c87d7f7ce" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-78238d1e-c404-4ec1-ab23-417c87d7f7ce" acquired by "delete_snapshot" :: waited 0.040s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-339357f1-98ed-4027-a27a-329d25ea9224" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-339357f1-98ed-4027-a27a-329d25ea9224" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Deleting offline snapshot 339357f1-98ed-4027-a27a-329d25ea9224 of volume 78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:23:48 devstack sudo[100415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306
Jun 15 04:23:48 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] snapshot_file for this snap is: volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2102d51f-0002-470a-ad9c-7097ed47c333]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:48 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224
Jun 15 04:23:48 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e84a5a1-8b52-401e-8fd0-40269ef80765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53686a46-44f1-40d7-bdf7-9f3a4ff9036c', 'volume_name': 'volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c', 'volume_size': 1, 'image_id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1536660418', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4ccbcdbdd5f34a1ba0385f22d2764653', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'created_at': datetime.datetime(2026, 6, 15, 2, 23, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 23, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c38ae930>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c81e76-bf4b-4165-92af-7f404a4211cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c81e76-bf4b-4165-92af-7f404a4211cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68a72ab-b7eb-40a9-835c-415f87ceb33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:48 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume 53686a46-44f1-40d7-bdf7-9f3a4ff9036c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c', 'volume_size': 1, 'image_id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1536660418', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4ccbcdbdd5f34a1ba0385f22d2764653', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'created_at': datetime.datetime(2026, 6, 15, 2, 23, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 23, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c38ae930>}
Jun 15 04:23:48 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Trying to clone 53686a46-44f1-40d7-bdf7-9f3a4ff9036c from image e0113c25-83f1-4e94-9e61-1403e5d3d17d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:23:49 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306" returned: 0 in 0.659s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1881743642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17129a61-4816-45e3-b5d8-cfd4a546bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ccbcdbdd5f34a1ba0385f22d2764653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:47Z,use_quota=True,user_id='7290d50d4b6b4d9f86db2d6d21bfa615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15787d50-028f-4592-8697-af144cff8f18),volume_type_id=15787d50-028f-4592-8697-af144cff8f18)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Creating volume 17129a61-4816-45e3-b5d8-cfd4a546bd35 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:49 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843fb21d-d9c9-43c7-8263-481f65c33ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306', 'volume_size': 2}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:49 devstack sudo[100421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 1073741824
Jun 15 04:23:49 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfef2255-f138-4257-8ff2-da35759188ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:49 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Volume volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 (6497ba9b-8b45-457d-88b4-71ca9aa0f306): created successfully
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfef2255-f138-4257-8ff2-da35759188ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Flow 'volume_create_manager' (88030e67-5025-42c0-9926-e0208d7c492c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fc526dd0-504d-4c6f-9c03-09c1a45b39d2 tempest-VolumesCloneNegativeTest-2850329 None] Created volume successfully.
Jun 15 04:23:49 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224" returned: 0 in 0.860s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02e937-273d-44af-b1c4-8d75c0042ecb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:49 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce
Jun 15 04:23:49 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:50 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 1073741824" returned: 0 in 0.971s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:50 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35
Jun 15 04:23:50 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:50 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce" returned: 0 in 0.980s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:50 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224
Jun 15 04:23:50 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Acquiring lock "cinder-6497ba9b-8b45-457d-88b4-71ca9aa0f306-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Lock "cinder-6497ba9b-8b45-457d-88b4-71ca9aa0f306-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Acquiring lock "cinder-quobyte-6497ba9b-8b45-457d-88b4-71ca9aa0f306" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Lock "cinder-quobyte-6497ba9b-8b45-457d-88b4-71ca9aa0f306" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b312c-d7ab-4200-80a7-228ae1dde354]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:50 devstack sudo[100441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306
Jun 15 04:23:50 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:50 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35" returned: 0 in 0.793s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.348s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-210174991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d0eafc-3e21-4125-af81-61afbb618171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ccbcdbdd5f34a1ba0385f22d2764653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:47Z,use_quota=True,user_id='7290d50d4b6b4d9f86db2d6d21bfa615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac3f5754-6d25-4b1c-810c-49f105de5186),volume_type_id=ac3f5754-6d25-4b1c-810c-49f105de5186)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Creating volume 02d0eafc-3e21-4125-af81-61afbb618171 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:50 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:50 devstack sudo[100444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 1073741824
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cbec39-6219-4547-bcfe-a0944c0dd9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17129a61-4816-45e3-b5d8-cfd4a546bd35', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:50 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:50 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c80308-2fc5-4587-99df-aa72cd95c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:51 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 (17129a61-4816-45e3-b5d8-cfd4a546bd35): created successfully
Jun 15 04:23:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c80308-2fc5-4587-99df-aa72cd95c147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Flow 'volume_create_manager' (842f672f-43e2-48ab-9abe-f2ed71437684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-25ce36ff-ee99-4313-9716-8822c4ea51ee tempest-TestInstancesWithCinderVolumes-1758291406 None] Created volume successfully.
Jun 15 04:23:51 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224" returned: 0 in 1.007s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:51 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224
Jun 15 04:23:51 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:51 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306" returned: 0 in 1.200s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:51 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306
Jun 15 04:23:51 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:52 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 1073741824" returned: 0 in 1.441s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:52 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171
Jun 15 04:23:52 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:52 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce.339357f1-98ed-4027-a27a-329d25ea9224" returned: 0 in 1.274s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-339357f1-98ed-4027-a27a-329d25ea9224" released by "_delete_snapshot" :: held 4.228s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-78238d1e-c404-4ec1-ab23-417c87d7f7ce" released by "delete_snapshot" :: held 4.281s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:52 devstack cinder-volume[92103]: WARNING cinder.quota [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1417809326 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1417809326, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:23:52 devstack cinder-volume[92103]: WARNING cinder.quota [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1417809326 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1417809326, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:23:52 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6497ba9b-8b45-457d-88b4-71ca9aa0f306" returned: 0 in 1.077s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['d8bf44b5-3422-44a6-bf31-443aa23bb9a1', '008a5606-d20e-4694-b2c1-c0273dac4280', 'd5f8f764-2415-4fff-b868-1b358058c6e2', 'dcdabe1d-1a87-4820-8c12-7a0cb533a126'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Lock "cinder-quobyte-6497ba9b-8b45-457d-88b4-71ca9aa0f306" released by "delete_volume" :: held 2.354s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3f98fcb3-b4bc-4495-81a4-ae9222fe6563 tempest-GroupSnapshotsTest-1703780758 None] group_snapshot 621f5bd2-5938-4846-b838-c24b771389d2: deleted successfully
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Created reservations ['dcb773fc-5145-4085-a34a-76fd456602c7', 'd3fe883b-dfd9-4e20-a04a-35b269e2224d', 'c19035ff-8066-49a7-b64f-051eb4ebea84', '70dbafc0-fda9-4236-bc27-75181a86d1b6'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:53 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:53 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:53 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171" returned: 0 in 0.802s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c68086-967c-4d84-89d2-dcd331b625ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d0eafc-3e21-4125-af81-61afbb618171', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec72b52-a06a-4b91-ab1e-fdd2f6e2762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:53 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume volume-02d0eafc-3e21-4125-af81-61afbb618171 (02d0eafc-3e21-4125-af81-61afbb618171): created successfully
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec72b52-a06a-4b91-ab1e-fdd2f6e2762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Flow 'volume_create_manager' (a836d215-396e-4474-be4a-5f3fff9674e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-db98ba96-6756-4c9d-92cb-cc9e0a78c1ea tempest-TestInstancesWithCinderVolumes-1758291406 None] Created volume successfully.
Jun 15 04:23:53 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.876s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:53 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Deleted volume successfully.
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "cinder-quobyte-78238d1e-c404-4ec1-ab23-417c87d7f7ce" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-17767816-24ad-4b2f-9ef0-560ec5d199df tempest-VolumesCloneNegativeTest-2850329 None] Lock "cinder-6497ba9b-8b45-457d-88b4-71ca9aa0f306-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-78238d1e-c404-4ec1-ab23-417c87d7f7ce" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15660b1-842f-4a72-9a95-2b1efc8fd101]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD, size 20.69 MB, duration 5.50 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:23:54 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Image download 20.69 MB at 3.76 MB/s
Jun 15 04:23:54 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce
Jun 15 04:23:54 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95e6350-38f0-4bae-b510-24f5cce3784a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:54 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD
Jun 15 04:23:54 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:54 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:55 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce
Jun 15 04:23:55 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:55 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD" returned: 0 in 0.893s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Temporary image e0113c25-83f1-4e94-9e61-1403e5d3d17d is fetched for user 7290d50d4b6b4d9f86db2d6d21bfa615. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[00954509-7f07-4e4e-ac60-8b0ecb4206d3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:55 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD
Jun 15 04:23:55 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:55 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78238d1e-c404-4ec1-ab23-417c87d7f7ce" returned: 0 in 0.734s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Lock "cinder-quobyte-78238d1e-c404-4ec1-ab23-417c87d7f7ce" released by "delete_volume" :: held 1.641s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['9e4e701a-6caf-46c0-bd59-1064efb97355'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:55 devstack cinder-volume[92103]: WARNING cinder.quota [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1417809326 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1417809326, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Created reservations ['b8e1d6c0-56dc-4460-ae1c-7e2194dcb896', 'cc5ee4d9-e5df-439a-84c0-0bcc4ac53750', 'afa05ea0-e5a5-454e-8536-82594bc083a6', 'd06f9577-ec82-49e8-b988-496b423179f1'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:56 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:23:56 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:56 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1418663525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53686a46-44f1-40d7-bdf7-9f3a4ff9036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ccbcdbdd5f34a1ba0385f22d2764653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:48Z,use_quota=True,user_id='7290d50d4b6b4d9f86db2d6d21bfa615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(669b3526-72c5-4eb4-84f7-af5cdca08ea7),volume_type_id=669b3526-72c5-4eb4-84f7-af5cdca08ea7)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Creating volume 53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:56 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:56 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c 1073741824
Jun 15 04:23:56 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:56 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.750s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:56 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:23:56 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-92f9a121-92d1-49d1-91e9-3194c7f3a524 tempest-GroupSnapshotsTest-1703780758 None] Delete group completed successfully.
Jun 15 04:23:57 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c 1073741824" returned: 0 in 0.926s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:57 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:23:57 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:57 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 0 in 0.690s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Attempting download of e0113c25-83f1-4e94-9e61-1403e5d3d17d ((None, [{'url': 'file:///opt/stack/data/glance/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'metadata': {}}])) to volume 53686a46-44f1-40d7-bdf7-9f3a4ff9036c. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[63851e9e-6e4f-41b1-9a7a-7574daad768a]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Flow 'volume_create_manager' (b1827eee-7c37-4431-a684-04f8476ed36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71881844-194f-4727-a302-cbc8105b8009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71881844-194f-4727-a302-cbc8105b8009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1238198292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7b1e49-ddaf-47d8-9e28-f561b33c2df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15fa6c880c64b8abd9705cba11ccdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:58Z,use_quota=True,user_id='9fbdbf28bc3140c7bfae63cadd6df58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8345703f-56d5-42f7-8842-adc6e9c5112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8345703f-56d5-42f7-8842-adc6e9c5112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:57 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd
Jun 15 04:23:57 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f19f374-ccae-4acd-9035-c43553bd90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f19f374-ccae-4acd-9035-c43553bd90ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7b1e49-ddaf-47d8-9e28-f561b33c2df7', 'volume_name': 'volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38903e96-698c-4a3f-a9dc-cdba8a23b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38903e96-698c-4a3f-a9dc-cdba8a23b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba97a90a-7961-4e54-a2bb-49edf9711d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:23:58 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Volume eb7b1e49-ddaf-47d8-9e28-f561b33c2df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7', 'volume_size': 1}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1238198292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7b1e49-ddaf-47d8-9e28-f561b33c2df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15fa6c880c64b8abd9705cba11ccdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:23:58Z,use_quota=True,user_id='9fbdbf28bc3140c7bfae63cadd6df58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Creating volume eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:23:58 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:58 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 1073741824
Jun 15 04:23:58 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:58 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd" returned: 0 in 0.780s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:58 devstack sudo[100556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd
Jun 15 04:23:58 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:59 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 1073741824" returned: 0 in 1.099s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:59 devstack sudo[100560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7
Jun 15 04:23:59 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:59 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd" returned: 1 in 0.851s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0113c25-83f1-4e94-9e61-1403e5d3d17d_wyglcxnd' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee76ebf1-e72d-42fc-8345-9b8cbaf4afc4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:23:59 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD
Jun 15 04:23:59 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:23:59 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7" returned: 0 in 0.802s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba97a90a-7961-4e54-a2bb-49edf9711d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:23:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b719f3ef-5291-4175-9c73-777dd33fe31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Volume volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 (eb7b1e49-ddaf-47d8-9e28-f561b33c2df7): created successfully
Jun 15 04:24:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b719f3ef-5291-4175-9c73-777dd33fe31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Flow 'volume_create_manager' (b1827eee-7c37-4431-a684-04f8476ed36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-971add8f-10f8-4e9c-9c19-bf3370cfe25a tempest-VolumesNegativeTest-1222015126 None] Created volume successfully.
Jun 15 04:24:00 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:00 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] e0113c25-83f1-4e94-9e61-1403e5d3d17d was qcow2, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:24:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:00 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:24:00 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:02 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 0 in 2.366s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:02 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0113c25-83f1-4e94-9e61-1403e5d3d17d_w9p_14tzdevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:24:02 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Converted 112.00 MB image at 47.31 MB/s
Jun 15 04:24:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:02 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c 1G
Jun 15 04:24:02 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:03 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c 1G" returned: 0 in 0.800s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbeecb5-78ba-4cd0-82f4-cf335c2f1658]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:24:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:03 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:24:03 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:04 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 0 in 0.830s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:04 devstack sudo[100592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:24:04 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:05 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 1 in 0.753s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Downloaded image e0113c25-83f1-4e94-9e61-1403e5d3d17d ((None, [{'url': 'file:///opt/stack/data/glance/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'metadata': {}}])) to volume 53686a46-44f1-40d7-bdf7-9f3a4ff9036c successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Temporary image e0113c25-83f1-4e94-9e61-1403e5d3d17d for user 7290d50d4b6b4d9f86db2d6d21bfa615 is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Marking volume 53686a46-44f1-40d7-bdf7-9f3a4ff9036c as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Copying metadata from image e0113c25-83f1-4e94-9e61-1403e5d3d17d to 53686a46-44f1-40d7-bdf7-9f3a4ff9036c. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Creating volume glance metadata for volume 53686a46-44f1-40d7-bdf7-9f3a4ff9036c backed by image e0113c25-83f1-4e94-9e61-1403e5d3d17d with: {'image_id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'image_name': 'tempest-scenario-img--1536660418', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68a72ab-b7eb-40a9-835c-415f87ceb33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c', 'volume_size': 1, 'image_id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1536660418', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4ccbcdbdd5f34a1ba0385f22d2764653', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0113c25-83f1-4e94-9e61-1403e5d3d17d', 'created_at': datetime.datetime(2026, 6, 15, 2, 23, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 23, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0113c25-83f1-4e94-9e61-1403e5d3d17d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c38ae930>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38137e79-2f33-4cb1-9286-a308b728af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:05 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Volume volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c (53686a46-44f1-40d7-bdf7-9f3a4ff9036c): created successfully
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38137e79-2f33-4cb1-9286-a308b728af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Flow 'volume_create_manager' (fd157705-986c-4535-96e2-732a5ab146ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-36d5d47f-b1ca-4495-ab5e-9ad8d21066ab tempest-TestInstancesWithCinderVolumes-1758291406 None] Created volume successfully.
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Flow 'volume_create_manager' (2a585c65-52ed-46e0-842e-c4872f75baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08e0e37-5a2d-40b5-984a-04a065802816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08e0e37-5a2d-40b5-984a-04a065802816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1746594202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcea860-e4e0-4b8c-8946-e8e16132999b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7c12570f6e42f9b6355989233f2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:09Z,use_quota=True,user_id='610d6df057424a36b38068eece6e2a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(159ac66a-34fa-493f-9365-88a1605e0adb),volume_type_id=159ac66a-34fa-493f-9365-88a1605e0adb)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa241cb-44a2-45e6-be8e-b5897c3bf43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa241cb-44a2-45e6-be8e-b5897c3bf43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1409c7e-c94e-488c-b4fe-878ebaf9097d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1409c7e-c94e-488c-b4fe-878ebaf9097d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcea860-e4e0-4b8c-8946-e8e16132999b', 'volume_name': 'volume-0fcea860-e4e0-4b8c-8946-e8e16132999b', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e215df39-eacb-4e28-86fd-9a4015744360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e215df39-eacb-4e28-86fd-9a4015744360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02444d19-81a8-4ea6-82c0-5950e6185172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:09 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Volume 0fcea860-e4e0-4b8c-8946-e8e16132999b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcea860-e4e0-4b8c-8946-e8e16132999b', 'volume_size': 1}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1746594202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcea860-e4e0-4b8c-8946-e8e16132999b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce7c12570f6e42f9b6355989233f2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:09Z,use_quota=True,user_id='610d6df057424a36b38068eece6e2a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(159ac66a-34fa-493f-9365-88a1605e0adb),volume_type_id=159ac66a-34fa-493f-9365-88a1605e0adb)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Creating volume 0fcea860-e4e0-4b8c-8946-e8e16132999b {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:24:09 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:24:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:09 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b 1073741824
Jun 15 04:24:09 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:10 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b 1073741824" returned: 0 in 0.993s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:10 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b
Jun 15 04:24:10 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:11 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b" returned: 0 in 0.726s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02444d19-81a8-4ea6-82c0-5950e6185172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcea860-e4e0-4b8c-8946-e8e16132999b', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db86b881-f3f9-498d-a1bb-78651d1caf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:11 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Volume volume-0fcea860-e4e0-4b8c-8946-e8e16132999b (0fcea860-e4e0-4b8c-8946-e8e16132999b): created successfully
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db86b881-f3f9-498d-a1bb-78651d1caf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Flow 'volume_create_manager' (2a585c65-52ed-46e0-842e-c4872f75baaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-63140160-48b7-4502-b046-11d9e635bcb9 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Created volume successfully.
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:12 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:24:12 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:12 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:12 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:24:12 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8f2413fc-5a7d-4357-b359-2486034155a0 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Retype volume completed successfully.
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df53b5e-8721-4c69-b53c-8b8db87ef77f]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Acquiring lock "cinder-0fcea860-e4e0-4b8c-8946-e8e16132999b-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "cinder-0fcea860-e4e0-4b8c-8946-e8e16132999b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:24:13 devstack sudo[100664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:24:13 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Acquiring lock "cinder-quobyte-0fcea860-e4e0-4b8c-8946-e8e16132999b" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "cinder-quobyte-0fcea860-e4e0-4b8c-8946-e8e16132999b" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0222eab7-7118-41aa-bd2a-18a350f266d7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:24:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:13 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b
Jun 15 04:24:13 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:14 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 0 in 0.970s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:14 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:24:14 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:14 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b" returned: 0 in 0.834s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:14 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b
Jun 15 04:24:14 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:15 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 1 in 1.105s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.136s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6ab6297-cc50-4b4a-ba2f-6fa532c8edd6', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:24:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-6f110e0f-8442-4bbb-9b57-87b656b9994c req-400aaead-4ef8-4c9e-af1a-0f3c2ee21eb3 tempest-TestInstancesWithCinderVolumes-1758291406 None] attachment_update completed successfully.
Jun 15 04:24:15 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0fcea860-e4e0-4b8c-8946-e8e16132999b" returned: 0 in 1.204s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "cinder-quobyte-0fcea860-e4e0-4b8c-8946-e8e16132999b" released by "delete_volume" :: held 2.107s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:24:15 devstack cinder-volume[92103]: WARNING cinder.quota [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:24:15 devstack cinder-volume[92103]: WARNING cinder.quota [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Created reservations ['07dcb860-b403-45ca-98fc-0c7df8bca540', 'f0b20c36-df2e-40a4-9d0d-69e5680cb02a', 'ae7ceb47-6d6c-42a3-802c-078eaa4fc10c', 'd4a17086-fb09-43a6-8643-733613f3cb44'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:15 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:24:15 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:16 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.124s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:16 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:24:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Deleted volume successfully.
Jun 15 04:24:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a78690d-c4a6-44a5-bab0-8f4190217014 tempest-VolumeRetypeWithoutMigrationTest-2039004628 None] Lock "cinder-0fcea860-e4e0-4b8c-8946-e8e16132999b-delete_volume" released by "delete_volume" :: held 3.602s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:24:25 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=94,cinder:INSERT=33,cinder:UPDATE=112,cinder:DELETE=6 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:24:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=118,cinder:SELECT=106,cinder:INSERT=27,cinder:DELETE=6 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:24:28 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:24:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Flow 'volume_create_manager' (5d677ab5-98ad-4a24-915c-cce025a2c7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e0e121-aa96-4f70-bc1f-38a8757cf08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e0e121-aa96-4f70-bc1f-38a8757cf08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1778075647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a21045-e84d-464f-a34d-0e6f1f348b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6da1b703344c388c654a2ecf68d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:29Z,use_quota=True,user_id='41f9e7dcfde643148f6ee09a1c26eaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba00c39d-e5cd-4350-89f8-1bc7c22a52d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba00c39d-e5cd-4350-89f8-1bc7c22a52d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfb0f30-1bf9-40dc-bf40-8db6c12da629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfb0f30-1bf9-40dc-bf40-8db6c12da629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a21045-e84d-464f-a34d-0e6f1f348b16', 'volume_name': 'volume-f6a21045-e84d-464f-a34d-0e6f1f348b16', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe6d054-23c1-4b26-a687-52c79637bdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe6d054-23c1-4b26-a687-52c79637bdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefbbaeb-6a95-420e-ab3d-c4b5d479c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Volume f6a21045-e84d-464f-a34d-0e6f1f348b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a21045-e84d-464f-a34d-0e6f1f348b16', 'volume_size': 1}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1778075647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a21045-e84d-464f-a34d-0e6f1f348b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6da1b703344c388c654a2ecf68d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:29Z,use_quota=True,user_id='41f9e7dcfde643148f6ee09a1c26eaea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Creating volume f6a21045-e84d-464f-a34d-0e6f1f348b16 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:24:29 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:24:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:29 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 1073741824
Jun 15 04:24:29 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:30 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 1073741824" returned: 0 in 1.654s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:30 devstack sudo[101344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16
Jun 15 04:24:30 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:32 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16" returned: 0 in 1.176s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] <== create_volume: return (2926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.931s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefbbaeb-6a95-420e-ab3d-c4b5d479c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a21045-e84d-464f-a34d-0e6f1f348b16', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5104204-aec9-40a4-8f97-74d9afa80ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:32 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Volume volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 (f6a21045-e84d-464f-a34d-0e6f1f348b16): created successfully
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5104204-aec9-40a4-8f97-74d9afa80ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:32 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Flow 'volume_create_manager' (5d677ab5-98ad-4a24-915c-cce025a2c7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-78f13397-b725-4d84-84d6-15b594f9c323 tempest-VolumesServicesTestJSON-1752051318 None] Created volume successfully.
Jun 15 04:24:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Acquiring lock "cinder-f6a21045-e84d-464f-a34d-0e6f1f348b16-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:24:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Lock "cinder-f6a21045-e84d-464f-a34d-0e6f1f348b16-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:24:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Acquiring lock "cinder-quobyte-f6a21045-e84d-464f-a34d-0e6f1f348b16" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:24:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Lock "cinder-quobyte-f6a21045-e84d-464f-a34d-0e6f1f348b16" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:24:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a247ea-9838-486c-a8ed-fe98d3ddc29f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:24:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:33 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16
Jun 15 04:24:33 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:34 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16" returned: 0 in 0.883s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:34 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16
Jun 15 04:24:34 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:35 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6a21045-e84d-464f-a34d-0e6f1f348b16" returned: 0 in 0.834s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:35 devstack sudo[101383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:24:35 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Lock "cinder-quobyte-f6a21045-e84d-464f-a34d-0e6f1f348b16" released by "delete_volume" :: held 1.806s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Created reservations ['42c45468-2b0e-4db6-8049-a9e6b8636555', '6cbf9bf7-f643-4436-92ee-eb5ffe7e5c32', '15d133df-de43-4c8f-8501-7240c658a4ed', 'adb44d10-8a6d-4240-9f71-198b0e21164c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:35 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:24:35 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:36 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.891s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:24:36 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.056s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:24:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Deleted volume successfully.
Jun 15 04:24:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-803148fc-648b-4a36-abb9-883d286f2dd0 tempest-VolumesServicesTestJSON-1752051318 None] Lock "cinder-f6a21045-e84d-464f-a34d-0e6f1f348b16-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:24:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Acquiring lock "cinder-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:24:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Lock "cinder-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:24:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Acquiring lock "cinder-quobyte-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:24:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Lock "cinder-quobyte-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:24:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e576ca-deef-488a-9980-e87153ec2363]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:24:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:39 devstack sudo[101450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7
Jun 15 04:24:39 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:39 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7" returned: 0 in 0.822s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:39 devstack sudo[101455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7
Jun 15 04:24:39 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:40 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7" returned: 0 in 0.954s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:40 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Lock "cinder-quobyte-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7" released by "delete_volume" :: held 1.836s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:24:40 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Created reservations ['34e70016-4b1d-4299-961f-63028babbec8', 'dcb71988-1a64-4228-b337-25d16bcc6bd0', '9cfcabdf-0029-458f-b032-d3eb310c28c8', '9581ed69-a77c-4b7b-b8b8-f848d6fc9e5c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:41 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:24:41 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:41 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.871s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:24:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Deleted volume successfully.
Jun 15 04:24:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c61cb5e1-268e-40bb-9791-066609c5c554 tempest-VolumesNegativeTest-1222015126 None] Lock "cinder-eb7b1e49-ddaf-47d8-9e28-f561b33c2df7-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Flow 'volume_create_manager' (795c37d6-24c2-4b05-8c69-38f7a3dafd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb7018-cc52-4096-bb95-135a44addce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb7018-cc52-4096-bb95-135a44addce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-366822748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5080fb97-96a3-4467-8e24-019aa3669680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ba38ddadf7489a880b2f0386b5412d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:45Z,use_quota=True,user_id='19d31faf49744008bfe021d12c888903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53953b70-e447-49c7-bf02-a336aebed399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53953b70-e447-49c7-bf02-a336aebed399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1767cd87-5607-4832-a9a2-242439d1a979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1767cd87-5607-4832-a9a2-242439d1a979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5080fb97-96a3-4467-8e24-019aa3669680', 'volume_name': 'volume-5080fb97-96a3-4467-8e24-019aa3669680', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea8c208-2305-4c83-93d5-245d102ee2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea8c208-2305-4c83-93d5-245d102ee2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af66fbe3-0e32-43d4-b518-a48b2142b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:45 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Volume 5080fb97-96a3-4467-8e24-019aa3669680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5080fb97-96a3-4467-8e24-019aa3669680', 'volume_size': 1}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-366822748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5080fb97-96a3-4467-8e24-019aa3669680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ba38ddadf7489a880b2f0386b5412d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:45Z,use_quota=True,user_id='19d31faf49744008bfe021d12c888903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Creating volume 5080fb97-96a3-4467-8e24-019aa3669680 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:24:45 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:24:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:45 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680 1073741824
Jun 15 04:24:45 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:46 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680 1073741824" returned: 0 in 0.933s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:46 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680
Jun 15 04:24:46 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:46 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af66fbe3-0e32-43d4-b518-a48b2142b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5080fb97-96a3-4467-8e24-019aa3669680', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dcc1a6-d4fd-4d98-ac12-664d5642970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:46 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Volume volume-5080fb97-96a3-4467-8e24-019aa3669680 (5080fb97-96a3-4467-8e24-019aa3669680): created successfully
Jun 15 04:24:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dcc1a6-d4fd-4d98-ac12-664d5642970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Flow 'volume_create_manager' (795c37d6-24c2-4b05-8c69-38f7a3dafd8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d3c4b84e-fcab-4b81-b100-9c0d8195cd3a tempest-AttachVolumeShelveTestJSON-2068040000 None] Created volume successfully.
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (d56b71e8-f427-4bd8-9ee9-5979bf7742fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459b329d-70bc-41a1-886c-940ee32757d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459b329d-70bc-41a1-886c-940ee32757d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596571247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fba66a-f810-49d1-8ac1-62762b460d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:56Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40bff82-814c-419c-95c5-9862d2c4f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40bff82-814c-419c-95c5-9862d2c4f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e9dc50-758c-4e68-89fc-5c8de74fedca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e9dc50-758c-4e68-89fc-5c8de74fedca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fba66a-f810-49d1-8ac1-62762b460d5f', 'volume_name': 'volume-e4fba66a-f810-49d1-8ac1-62762b460d5f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789b2a3c-b5bd-451b-a642-28f7122996a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789b2a3c-b5bd-451b-a642-28f7122996a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f54eb33-63bc-4f9a-a15e-fff87c24ad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:55 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Volume e4fba66a-f810-49d1-8ac1-62762b460d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fba66a-f810-49d1-8ac1-62762b460d5f', 'volume_size': 1}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596571247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fba66a-f810-49d1-8ac1-62762b460d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:24:56Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Creating volume e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:24:55 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:24:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:56 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f 1073741824
Jun 15 04:24:56 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:56 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f 1073741824" returned: 0 in 0.912s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:56 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f
Jun 15 04:24:56 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:57 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f" returned: 0 in 0.774s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f54eb33-63bc-4f9a-a15e-fff87c24ad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fba66a-f810-49d1-8ac1-62762b460d5f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a50aa24-b50c-49f0-a98c-3490dda36465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:24:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Volume volume-e4fba66a-f810-49d1-8ac1-62762b460d5f (e4fba66a-f810-49d1-8ac1-62762b460d5f): created successfully
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a50aa24-b50c-49f0-a98c-3490dda36465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:24:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (d56b71e8-f427-4bd8-9ee9-5979bf7742fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:24:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8b1c4d82-add0-4b0a-905c-12120139667a tempest-VolumesSnapshotTestJSON-189487870 None] Created volume successfully.
Jun 15 04:24:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:24:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Creating offline snapshot f233b6e7-4a98-4e5d-831d-b85e05cc72bb of volume e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:24:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f15b1cc-612a-43e4-85cb-12690da5e1b0]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:24:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:58 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f
Jun 15 04:24:58 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:24:59 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Jun 15 04:24:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f" returned: 0 in 0.800s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:24:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:24:59 devstack sudo[101651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb 1G
Jun 15 04:24:59 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:24:59 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb 1G" returned: 0 in 0.922s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fba66a-f810-49d1-8ac1-62762b460d5f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:00 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fba66a-f810-49d1-8ac1-62762b460d5f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb
Jun 15 04:25:00 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:00 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fba66a-f810-49d1-8ac1-62762b460d5f -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb" returned: 0 in 0.790s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:00 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb is being set with open permissions: ugo+rw
Jun 15 04:25:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:00 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb
Jun 15 04:25:00 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:01 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb" returned: 0 in 0.626s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:01 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info
Jun 15 04:25:01 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:02 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info" returned: 0 in 0.818s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:02 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info is being set with open permissions: ugo+rw
Jun 15 04:25:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:02 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info
Jun 15 04:25:02 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:03 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.info" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.799s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.240s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c0ef3-c640-4394-b981-777ec9d067ed]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:03 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9770fac8-fa60-435a-9547-8b90132f5efc tempest-VolumesSnapshotTestJSON-189487870 None] Create snapshot completed successfully
Jun 15 04:25:03 devstack sudo[101676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35
Jun 15 04:25:03 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-f233b6e7-4a98-4e5d-831d-b85e05cc72bb-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-f233b6e7-4a98-4e5d-831d-b85e05cc72bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-e4fba66a-f810-49d1-8ac1-62762b460d5f" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-e4fba66a-f810-49d1-8ac1-62762b460d5f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-f233b6e7-4a98-4e5d-831d-b85e05cc72bb" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-f233b6e7-4a98-4e5d-831d-b85e05cc72bb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Deleting offline snapshot f233b6e7-4a98-4e5d-831d-b85e05cc72bb of volume e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:25:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] snapshot_file for this snap is: volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:25:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116374c-0299-43ba-8fd5-5f6d2b619c6a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:04 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35" returned: 0 in 1.091s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.119s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-17129a61-4816-45e3-b5d8-cfd4a546bd35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1373998-830a-4e21-baa9-acb2f47500e8', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:25:04 devstack sudo[101682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb
Jun 15 04:25:04 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-c1cdc47d-b1a5-4839-ba48-9ac3d8df4b89 req-3dab9b66-5561-4167-985d-78229f404861 tempest-TestInstancesWithCinderVolumes-1758291406 None] attachment_update completed successfully.
Jun 15 04:25:05 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb" returned: 0 in 1.193s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4fba66a-f810-49d1-8ac1-62762b460d5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:25:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[21664f09-f3b0-45e2-9850-91e1bb0fb5ab]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:05 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f
Jun 15 04:25:05 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:06 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f" returned: 0 in 0.889s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:06 devstack sudo[102024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb
Jun 15 04:25:06 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-3b8afd2f-58d0-4011-aa43-127595078ec8 req-cb692f0f-f193-47b2-b34d-98f7df40f724 tempest-AttachVolumeShelveTestJSON-2068040000 None] No connector for attachment 831b3a31-f3f9-4c5f-968d-9b7c2f402257; skipping storage backend terminate_connection call. {{(pid=92103) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 15 04:25:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-3b8afd2f-58d0-4011-aa43-127595078ec8 req-cb692f0f-f193-47b2-b34d-98f7df40f724 tempest-AttachVolumeShelveTestJSON-2068040000 None] Deleting attachment 831b3a31-f3f9-4c5f-968d-9b7c2f402257. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:25:07 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb" returned: 0 in 0.854s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:07 devstack sudo[102030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb
Jun 15 04:25:07 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:07 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f.f233b6e7-4a98-4e5d-831d-b85e05cc72bb" returned: 0 in 0.667s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-f233b6e7-4a98-4e5d-831d-b85e05cc72bb" released by "_delete_snapshot" :: held 3.766s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-e4fba66a-f810-49d1-8ac1-62762b460d5f" released by "delete_snapshot" :: held 3.799s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['77027d20-8f45-438b-8cf8-f0061e1da930', '6603a4e1-2318-40cc-8423-8ee2ac454e5f', 'd88a104f-694e-48fe-bbba-a8c765ea8cfa', '5e8f7aa9-64ea-44fd-8396-be447f4ba128'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Delete snapshot completed successfully.
Jun 15 04:25:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7d01eaf1-646d-4379-ad67-3664c178a79e tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-f233b6e7-4a98-4e5d-831d-b85e05cc72bb-delete_snapshot" released by "delete_snapshot" :: held 4.026s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (a584b892-c557-4923-8680-0e7c71e510e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb341cd6-c1c8-4e1e-b75c-61891d84df40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb341cd6-c1c8-4e1e-b75c-61891d84df40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1314226128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f7f3d3-6d23-4d12-8e59-47ce9e59e00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:09Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb672bd-6efc-4cd2-8896-6515b09b63be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb672bd-6efc-4cd2-8896-6515b09b63be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daac159-eab2-444e-913a-448700abcac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daac159-eab2-444e-913a-448700abcac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f7f3d3-6d23-4d12-8e59-47ce9e59e00e', 'volume_name': 'volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5f5730-43e5-4b63-a90f-e2079ef055a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5f5730-43e5-4b63-a90f-e2079ef055a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d921a9-abd3-45fc-bae1-df269bee4593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Volume 69f7f3d3-6d23-4d12-8e59-47ce9e59e00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e', 'volume_size': 1}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1314226128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f7f3d3-6d23-4d12-8e59-47ce9e59e00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:09Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Creating volume 69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:25:08 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:25:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:08 devstack sudo[102035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e 1073741824
Jun 15 04:25:08 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:09 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e 1073741824" returned: 0 in 1.016s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:09 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:09 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:10 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 0.640s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d921a9-abd3-45fc-bae1-df269bee4593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfb02ec-01c0-4762-825f-7772c6ed1e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:10 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Volume volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e (69f7f3d3-6d23-4d12-8e59-47ce9e59e00e): created successfully
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfb02ec-01c0-4762-825f-7772c6ed1e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (a584b892-c557-4923-8680-0e7c71e510e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:10 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0cd8e436-d1fa-4017-a910-67ea61151558 tempest-VolumesSnapshotTestJSON-189487870 None] Created volume successfully.
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Creating offline snapshot ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 of volume 69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b7877b-26fc-4934-b922-d1e3360fbee6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:11 devstack sudo[102051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:11 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:11 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 0.858s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:12 devstack sudo[102056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 1G
Jun 15 04:25:12 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:12 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 1G" returned: 0 in 0.952s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:12 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0
Jun 15 04:25:12 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:13 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" returned: 0 in 0.764s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:13 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 is being set with open permissions: ugo+rw
Jun 15 04:25:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:13 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0
Jun 15 04:25:13 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:14 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" returned: 0 in 0.606s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:14 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info
Jun 15 04:25:14 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:15 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info" returned: 0 in 0.713s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:15 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info is being set with open permissions: ugo+rw
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:15 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info
Jun 15 04:25:15 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:15 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.info" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.752s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.812s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3fbe21-9d08-4f7f-87c8-cb36dc3a326a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d5ee9810-b026-401a-a447-d0d47ec68f6d tempest-VolumesSnapshotTestJSON-189487870 None] Create snapshot completed successfully
Jun 15 04:25:16 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171
Jun 15 04:25:16 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:16 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171" returned: 0 in 0.941s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-02d0eafc-3e21-4125-af81-61afbb618171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bc13ec0-7b3b-4f7c-b44b-b609e8707f7f', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:25:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-81803a82-6620-437c-aebe-2ce6a7ec3ad0 req-cec5f02e-d528-4e60-ac58-af4e6294bed4 tempest-TestInstancesWithCinderVolumes-1758291406 None] attachment_update completed successfully.
Jun 15 04:25:16 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (cba7aae3-1c15-4b42-b726-41e211ba4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e9896-6a0d-43f1-b028-93f950a7499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e9896-6a0d-43f1-b028-93f950a7499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1313664407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ffafca-ce9e-40fc-acdb-3a68be21e22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:17Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0310bf82-2025-4569-8d3a-91bc6eabdd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0310bf82-2025-4569-8d3a-91bc6eabdd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d0ec2f-8abe-48d4-b2cb-4b70dc7d6928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d0ec2f-8abe-48d4-b2cb-4b70dc7d6928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44ffafca-ce9e-40fc-acdb-3a68be21e22d', 'volume_name': 'volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d', 'volume_size': 2, 'snapshot_id': 'ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47c4fe4-8484-4d16-add5-65381fdc3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47c4fe4-8484-4d16-add5-65381fdc3604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abeb14a-1dc2-4d50-80b5-03c6a14c7540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Volume 44ffafca-ce9e-40fc-acdb-3a68be21e22d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d', 'volume_size': 2, 'snapshot_id': 'ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0'}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0-44ffafca-ce9e-40fc-acdb-3a68be21e22d" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0-44ffafca-ce9e-40fc-acdb-3a68be21e22d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Creating volume 44ffafca-ce9e-40fc-acdb-3a68be21e22d from snapshot ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-44ffafca-ce9e-40fc-acdb-3a68be21e22d" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-44ffafca-ce9e-40fc-acdb-3a68be21e22d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] snapshot: ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0, volume: 44ffafca-ce9e-40fc-acdb-3a68be21e22d,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfc99b3-ab1e-4226-8e8e-99165950738d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:17 devstack sudo[102090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0
Jun 15 04:25:17 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:18 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" returned: 0 in 0.969s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f1d71-e5a4-451f-ac34-651143fb08be]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:18 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:18 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:18 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 0.727s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:25:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:18 devstack sudo[102189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d
Jun 15 04:25:19 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:25 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d" returned: 0 in 6.886s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:25 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd77a05-8ce8-42a3-a4c2-2bfd914cc340]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:26 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:26 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:27 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 1.141s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=45,cinder:SELECT=47,cinder:INSERT=10,cinder:DELETE=3 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:25:27 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Converted 1024.00 MB image at 148.61 MB/s
Jun 15 04:25:27 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d is being set with open permissions: ugo+rw
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:27 devstack sudo[102268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d
Jun 15 04:25:27 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=54,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=5 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:25:27 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d" returned: 0 in 0.657s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-44ffafca-ce9e-40fc-acdb-3a68be21e22d" released by "_copy_volume_from_snapshot" :: held 10.565s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0-44ffafca-ce9e-40fc-acdb-3a68be21e22d" released by "_create_volume_from_snapshot" :: held 10.625s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.644s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abeb14a-1dc2-4d50-80b5-03c6a14c7540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d', 'volume_size': 2, 'snapshot_id': 'ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8b0fe7-e677-4ae5-9fa6-bc7514361a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Volume volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d (44ffafca-ce9e-40fc-acdb-3a68be21e22d): created successfully
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8b0fe7-e677-4ae5-9fa6-bc7514361a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (cba7aae3-1c15-4b42-b726-41e211ba4e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:27 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c1eaedbd-2232-4e12-9241-3ced24ce727f tempest-VolumesSnapshotTestJSON-189487870 None] Created volume successfully.
Jun 15 04:25:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-44ffafca-ce9e-40fc-acdb-3a68be21e22d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-44ffafca-ce9e-40fc-acdb-3a68be21e22d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-44ffafca-ce9e-40fc-acdb-3a68be21e22d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-44ffafca-ce9e-40fc-acdb-3a68be21e22d" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea4bad-45f9-454e-a298-e0a073a470e6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:28 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d
Jun 15 04:25:28 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:29 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d" returned: 0 in 0.818s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:29 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d
Jun 15 04:25:29 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-32213e40-5740-4783-98fd-94ab00c59c56 req-63ef4a9f-ec4b-4ff5-9041-190fc5660d01 tempest-TestInstancesWithCinderVolumes-1758291406 None] Terminate volume connection completed successfully.
Jun 15 04:25:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-32213e40-5740-4783-98fd-94ab00c59c56 req-63ef4a9f-ec4b-4ff5-9041-190fc5660d01 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deleting attachment b1373998-830a-4e21-baa9-acb2f47500e8. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:25:30 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-44ffafca-ce9e-40fc-acdb-3a68be21e22d" returned: 0 in 0.763s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-44ffafca-ce9e-40fc-acdb-3a68be21e22d" released by "delete_volume" :: held 1.671s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['7d2a56fb-b831-4ade-8e0e-8df8b65ff837', '0bb768f5-391a-4ed4-9d04-7c8707059372', '900b49df-126f-4288-8342-b8c6ec36b3af', 'b234605b-90c4-432f-a8ba-7b83ff8f592b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:30 devstack sudo[102366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:25:30 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Deleting offline snapshot ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 of volume 69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] snapshot_file for this snap is: volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb55cf3-c76c-4e2d-bc5b-9cd0cd1b095d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:31 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0
Jun 15 04:25:31 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:31 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.008s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:25:31 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Deleted volume successfully.
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b3f6883c-2ce2-4736-8d7a-454f2ac71abc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-44ffafca-ce9e-40fc-acdb-3a68be21e22d-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "cinder-17129a61-4816-45e3-b5d8-cfd4a546bd35-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-17129a61-4816-45e3-b5d8-cfd4a546bd35-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "cinder-quobyte-17129a61-4816-45e3-b5d8-cfd4a546bd35" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-quobyte-17129a61-4816-45e3-b5d8-cfd4a546bd35" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbf038-945e-4ed8-9b18-8bef335e7448]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:31 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35
Jun 15 04:25:31 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:32 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" returned: 0 in 1.040s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:32 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:25:32 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb45e73d-57c7-46b6-a782-8ea7e30a2476]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:32 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:32 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:32 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35" returned: 0 in 1.167s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:32 devstack sudo[102403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35
Jun 15 04:25:32 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:33 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 1.352s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:33 devstack sudo[102409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0
Jun 15 04:25:33 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:33 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-17129a61-4816-45e3-b5d8-cfd4a546bd35" returned: 0 in 1.064s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-quobyte-17129a61-4816-45e3-b5d8-cfd4a546bd35" released by "delete_volume" :: held 2.286s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:34 devstack cinder-volume[92103]: WARNING cinder.quota [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736112088-1992547927 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736112088-1992547927, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:25:34 devstack cinder-volume[92103]: WARNING cinder.quota [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736112088-1992547927 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736112088-1992547927, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Created reservations ['b3191f02-2b65-427d-a88f-d2e41f3151d8', 'b5cb5535-0525-40fa-9c8f-211946046fcb', '0e5ca537-1927-48eb-b860-8609014b3163', '3b9daaf6-192a-42ee-8d0d-5a990fdbe392'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:34 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:25:34 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:34 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" returned: 0 in 1.074s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:34 devstack sudo[102421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0
Jun 15 04:25:34 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:34 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.825s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:34 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:25:35 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Deleted volume successfully.
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-f292a2f0-3dbe-41df-949e-fe6fe0754eac tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-17129a61-4816-45e3-b5d8-cfd4a546bd35-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:35 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e.ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" returned: 0 in 0.732s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0" released by "_delete_snapshot" :: held 4.433s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" released by "delete_snapshot" :: held 4.491s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:35 devstack sudo[102437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:25:35 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['b7eea370-24e3-42c3-aad9-ee0fbec1adf2', '6e5e4dd2-c035-422a-a288-0d86b716be17', '379f311d-4bdd-4eb6-81c9-2792a4d737d9', '53f62fea-f434-4916-b9a1-9b09b39b2162'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:35 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Delete snapshot completed successfully.
Jun 15 04:25:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-eea6f0cf-e652-43ea-9c10-90b7546b60ff tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-ad9d4016-2761-4ec1-91a0-ab22b1fdc1e0-delete_snapshot" released by "delete_snapshot" :: held 4.703s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:36 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.682s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" acquired by "delete_volume" :: waited 0.041s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bad41f9-34e9-4a7f-ad80-64dc391e2700]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:36 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:36 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:37 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 1.128s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:37 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e
Jun 15 04:25:37 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:38 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" returned: 0 in 0.675s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e" released by "delete_volume" :: held 1.961s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['ecac5f75-8ac4-4a64-830a-f8fd5fd2a40d', '8decf0b3-7c04-4476-a6aa-4053aac4dffc', 'eed9da6d-e2c4-4766-84c7-0c9948d9168d', '9777bcaf-4ec4-46d8-9b99-7250a619ca4b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:38 devstack sudo[102555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:25:38 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (7f38facb-5603-4d78-84c9-3a8942a567ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b55e11-cb0e-41ed-b0c2-7487ffc072cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b55e11-cb0e-41ed-b0c2-7487ffc072cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2132214050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0e46df-0bfc-4578-9911-bb2984321c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:40Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b80af55-3489-4733-9aba-b56c230269f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:39 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b80af55-3489-4733-9aba-b56c230269f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83283133-47b7-4d92-ac95-485710c4cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83283133-47b7-4d92-ac95-485710c4cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0e46df-0bfc-4578-9911-bb2984321c34', 'volume_name': 'volume-bc0e46df-0bfc-4578-9911-bb2984321c34', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be3fea6-a158-4ddc-a0e9-87e4bbb31b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be3fea6-a158-4ddc-a0e9-87e4bbb31b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3323db70-3ae1-4119-9eab-c8f02c4a9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:39 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Volume bc0e46df-0bfc-4578-9911-bb2984321c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0e46df-0bfc-4578-9911-bb2984321c34', 'volume_size': 1}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2132214050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0e46df-0bfc-4578-9911-bb2984321c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:40Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Creating volume bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:25:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:25:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.167s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:25:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Deleted volume successfully.
Jun 15 04:25:40 devstack sudo[102560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 1073741824
Jun 15 04:25:40 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-296b67d8-1cac-42a0-981e-27f71d952c9d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-69f7f3d3-6d23-4d12-8e59-47ce9e59e00e-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-ea707166-3cd3-4ed5-9604-335f3b760aed req-bdbab85f-1647-488f-81c1-feb683d8ba08 tempest-TestInstancesWithCinderVolumes-1758291406 None] Terminate volume connection completed successfully.
Jun 15 04:25:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-ea707166-3cd3-4ed5-9604-335f3b760aed req-bdbab85f-1647-488f-81c1-feb683d8ba08 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deleting attachment 2bc13ec0-7b3b-4f7c-b44b-b609e8707f7f. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:25:41 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 1073741824" returned: 0 in 1.189s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:41 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:25:41 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (95d15a74-dbce-4014-a18b-18773548ea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b45c315-cd9c-4b99-99ff-5ad7e3261114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b45c315-cd9c-4b99-99ff-5ad7e3261114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861397207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a5169-28bd-45a1-9b64-282899602e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:41Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b3c99e-54c8-4682-a839-6e36e3a8f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b3c99e-54c8-4682-a839-6e36e3a8f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a28cb14-208f-46cc-a873-e637dd9846b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a28cb14-208f-46cc-a873-e637dd9846b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1a5169-28bd-45a1-9b64-282899602e53', 'volume_name': 'volume-ed1a5169-28bd-45a1-9b64-282899602e53', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f54f00-0ee0-48ba-989c-41cb7c5db69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f54f00-0ee0-48ba-989c-41cb7c5db69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9262d7fc-9cde-468b-9a51-6a6ab15f4265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:41 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Volume ed1a5169-28bd-45a1-9b64-282899602e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1a5169-28bd-45a1-9b64-282899602e53', 'volume_size': 1}
Jun 15 04:25:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:42 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 0.846s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861397207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a5169-28bd-45a1-9b64-282899602e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:41Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Creating volume ed1a5169-28bd-45a1-9b64-282899602e53 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:25:42 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3323db70-3ae1-4119-9eab-c8f02c4a9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0e46df-0bfc-4578-9911-bb2984321c34', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d698e1dc-4c68-4dbe-822c-ad80e615f3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:42 devstack sudo[102571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53 1073741824
Jun 15 04:25:42 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:42 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Volume volume-bc0e46df-0bfc-4578-9911-bb2984321c34 (bc0e46df-0bfc-4578-9911-bb2984321c34): created successfully
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d698e1dc-4c68-4dbe-822c-ad80e615f3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (7f38facb-5603-4d78-84c9-3a8942a567ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7578f989-e727-4046-9622-5050f8574676 tempest-VolumesSnapshotTestJSON-189487870 None] Created volume successfully.
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "cinder-02d0eafc-3e21-4125-af81-61afbb618171-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-02d0eafc-3e21-4125-af81-61afbb618171-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "cinder-quobyte-02d0eafc-3e21-4125-af81-61afbb618171" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-quobyte-02d0eafc-3e21-4125-af81-61afbb618171" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc3d62-3fac-477a-a8c4-7b8abc0a64f4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:43 devstack sudo[102576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171
Jun 15 04:25:43 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:43 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53 1073741824" returned: 0 in 1.278s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:43 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53
Jun 15 04:25:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:43 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:44 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171" returned: 0 in 1.299s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:44 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171
Jun 15 04:25:44 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:44 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53" returned: 0 in 1.231s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.650s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.181s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9262d7fc-9cde-468b-9a51-6a6ab15f4265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1a5169-28bd-45a1-9b64-282899602e53', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a9d452-a108-4721-b244-ed78e20dd43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Creating offline snapshot a61964b8-4e8c-443b-952f-aa3f0015d36d of volume bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:25:44 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Volume volume-ed1a5169-28bd-45a1-9b64-282899602e53 (ed1a5169-28bd-45a1-9b64-282899602e53): created successfully
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a9d452-a108-4721-b244-ed78e20dd43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (95d15a74-dbce-4014-a18b-18773548ea67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee4643f-0f39-47ab-9254-eeec7a4a7cf1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-29b36d69-2755-474d-ab22-52e35c6af7dc tempest-VolumesActionsTest-1538163963 None] Created volume successfully.
Jun 15 04:25:45 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-02d0eafc-3e21-4125-af81-61afbb618171" returned: 0 in 0.943s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-quobyte-02d0eafc-3e21-4125-af81-61afbb618171" released by "delete_volume" :: held 2.305s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:45 devstack cinder-volume[92103]: WARNING cinder.quota [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504244250-1338750112 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504244250-1338750112, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:25:45 devstack cinder-volume[92103]: WARNING cinder.quota [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504244250-1338750112 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504244250-1338750112, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:25:45 devstack sudo[102588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:25:45 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Created reservations ['cf23bf60-62b7-46f9-a994-8080a4693566', '5b0d1450-5872-47c9-b016-d881c79967c0', '6022be10-8891-4158-abb3-e8a0033036ce', '14332287-02c8-4aba-a199-88cc55708a8c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:45 devstack sudo[102594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:25:45 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9e9f82a4-278e-453c-adb6-42f0cd971bd4 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53" by "attach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9e9f82a4-278e-453c-adb6-42f0cd971bd4 tempest-VolumesActionsTest-1538163963 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53" acquired by "attach_volume" :: waited 0.037s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9e9f82a4-278e-453c-adb6-42f0cd971bd4 tempest-VolumesActionsTest-1538163963 None] Attaching volume ed1a5169-28bd-45a1-9b64-282899602e53 to instance fc10f3fe-f693-461c-8bf4-a45cfee055e8 at mountpoint /dev/vdb on host None.
Jun 15 04:25:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9e9f82a4-278e-453c-adb6-42f0cd971bd4 tempest-VolumesActionsTest-1538163963 None] Attach volume completed successfully.
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9e9f82a4-278e-453c-adb6-42f0cd971bd4 tempest-VolumesActionsTest-1538163963 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53" released by "attach_volume" :: held 0.141s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:46 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.154s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:25:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deleted volume successfully.
Jun 15 04:25:46 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 1.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-bc574a18-7d0c-43d8-ab69-515ed62a9921 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-02d0eafc-3e21-4125-af81-61afbb618171-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:46 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d 1G
Jun 15 04:25:46 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-93ad1f9f-be95-4694-a674-379a04e2c187 tempest-VolumesActionsTest-2039468359 None] Terminate volume connection completed successfully.
Jun 15 04:25:47 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d 1G" returned: 0 in 1.264s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e46df-0bfc-4578-9911-bb2984321c34 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:47 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e46df-0bfc-4578-9911-bb2984321c34 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d
Jun 15 04:25:47 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-93ad1f9f-be95-4694-a674-379a04e2c187 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-detach_volume" by "detach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-93ad1f9f-be95-4694-a674-379a04e2c187 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-93ad1f9f-be95-4694-a674-379a04e2c187 tempest-VolumesActionsTest-2039468359 None] Detaching volume ed1a5169-28bd-45a1-9b64-282899602e53 from instance fc10f3fe-f693-461c-8bf4-a45cfee055e8.
Jun 15 04:25:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-93ad1f9f-be95-4694-a674-379a04e2c187 tempest-VolumesActionsTest-2039468359 None] Detach volume completed successfully.
Jun 15 04:25:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-93ad1f9f-be95-4694-a674-379a04e2c187 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0c4e566a-a182-4421-add8-593c8ead349a tempest-VolumesActionsTest-1538163963 None] Acquiring lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-detach_volume" by "detach_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:48 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e46df-0bfc-4578-9911-bb2984321c34 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d" returned: 0 in 0.769s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:48 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d is being set with open permissions: ugo+rw
Jun 15 04:25:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0c4e566a-a182-4421-add8-593c8ead349a tempest-VolumesActionsTest-1538163963 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0c4e566a-a182-4421-add8-593c8ead349a tempest-VolumesActionsTest-1538163963 None] Volume detach called, but volume not attached.
Jun 15 04:25:48 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d
Jun 15 04:25:48 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0c4e566a-a182-4421-add8-593c8ead349a tempest-VolumesActionsTest-1538163963 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "cinder-quobyte-ed1a5169-28bd-45a1-9b64-282899602e53" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Lock "cinder-quobyte-ed1a5169-28bd-45a1-9b64-282899602e53" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36fdd65-3c6b-4b20-a82e-38f73f377eea]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:49 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d" returned: 0 in 1.286s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:49 devstack sudo[102654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info
Jun 15 04:25:49 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:50 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53
Jun 15 04:25:50 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:50 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info" returned: 0 in 0.668s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:50 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info is being set with open permissions: ugo+rw
Jun 15 04:25:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:50 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info
Jun 15 04:25:50 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:50 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53" returned: 0 in 0.990s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:50 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53
Jun 15 04:25:50 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:51 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.info" returned: 0 in 1.035s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:51 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.953s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ed1a5169-28bd-45a1-9b64-282899602e53" returned: 0 in 0.853s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Lock "cinder-quobyte-ed1a5169-28bd-45a1-9b64-282899602e53" released by "delete_volume" :: held 1.974s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-21c44d37-366b-49fb-9683-5ed682e2a27c tempest-VolumesSnapshotTestJSON-189487870 None] Create snapshot completed successfully
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Created reservations ['d3b948d8-d420-4a0f-a89d-b7a03ec45680', '68fc5957-4f95-481e-95d1-2e9bd6cf8d57', 'ae91dac7-b94b-48ec-895b-d9fb9f5b2722', '3be70572-baa1-40cb-8394-62937e88f383'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:51 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:25:51 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-f57d4bcf-0836-4bd7-b37a-794cf365b2f5 req-be5da62f-b673-4471-aec7-60a219d6dea9 tempest-TestInstancesWithCinderVolumes-1758291406 None] Terminate volume connection completed successfully.
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-f57d4bcf-0836-4bd7-b37a-794cf365b2f5 req-be5da62f-b673-4471-aec7-60a219d6dea9 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deleting attachment e6ab6297-cc50-4b4a-ba2f-6fa532c8edd6. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:25:52 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.885s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (115b28eb-34ec-4f22-b75b-2bc582f243ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f6cfa7-d0be-4c40-ad25-4b8321bb9b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Deleted volume successfully.
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f6cfa7-d0be-4c40-ad25-4b8321bb9b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-440616464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298c98ca-89da-4a5c-a204-c9aab8e252b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4db7479b537448089a8304813545c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a61964b8-4e8c-443b-952f-aa3f0015d36d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:25:53Z,use_quota=True,user_id='8001bc3c5d9d47ef9fa5651d848c4257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6783036d-6b05-404f-b41d-b3b1f9e2d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6783036d-6b05-404f-b41d-b3b1f9e2d69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cf6c02-93ac-4b3e-b78d-84e3b224359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cf6c02-93ac-4b3e-b78d-84e3b224359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '298c98ca-89da-4a5c-a204-c9aab8e252b3', 'volume_name': 'volume-298c98ca-89da-4a5c-a204-c9aab8e252b3', 'volume_size': 1, 'snapshot_id': 'a61964b8-4e8c-443b-952f-aa3f0015d36d'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c175fc72-b210-4945-b9ad-76165db4a1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c175fc72-b210-4945-b9ad-76165db4a1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285ed273-9ad0-4c64-bc22-24c7846f0352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:25:52 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Volume 298c98ca-89da-4a5c-a204-c9aab8e252b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-298c98ca-89da-4a5c-a204-c9aab8e252b3', 'volume_size': 1, 'snapshot_id': 'a61964b8-4e8c-443b-952f-aa3f0015d36d'}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-a61964b8-4e8c-443b-952f-aa3f0015d36d-298c98ca-89da-4a5c-a204-c9aab8e252b3" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3c85235e-23fb-41b6-a0ef-1407de45d533 tempest-VolumesActionsTest-1538163963 None] Lock "cinder-ed1a5169-28bd-45a1-9b64-282899602e53-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-a61964b8-4e8c-443b-952f-aa3f0015d36d-298c98ca-89da-4a5c-a204-c9aab8e252b3" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Creating volume 298c98ca-89da-4a5c-a204-c9aab8e252b3 from snapshot a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:25:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-298c98ca-89da-4a5c-a204-c9aab8e252b3" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-298c98ca-89da-4a5c-a204-c9aab8e252b3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] snapshot: a61964b8-4e8c-443b-952f-aa3f0015d36d, volume: 298c98ca-89da-4a5c-a204-c9aab8e252b3,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051cbd3-a754-42eb-a0ac-ab4ed160a56b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:53 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d
Jun 15 04:25:53 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:53 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d" returned: 0 in 0.853s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e46df-0bfc-4578-9911-bb2984321c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ef3f0-9b5f-405d-b7d1-0dfacc7eb1b6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:54 devstack sudo[102717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:25:54 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:54 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 1.014s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:54 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:25:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:54 devstack sudo[102756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3
Jun 15 04:25:54 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "cinder-53686a46-44f1-40d7-bdf7-9f3a4ff9036c-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-53686a46-44f1-40d7-bdf7-9f3a4ff9036c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "cinder-quobyte-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:25:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-quobyte-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" acquired by "delete_volume" :: waited 0.064s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:25:56 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09799c-46a3-4c52-b11e-325e6a6f4084]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:25:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:56 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:25:56 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:25:58 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Jun 15 04:25:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 0 in 2.445s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:25:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:25:59 devstack sudo[102811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:25:59 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:00 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 1 in 1.885s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:26:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:00 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c
Jun 15 04:26:00 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:01 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3" returned: 0 in 6.844s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:01 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9221a-3065-4395-9a35-230db27caa58]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:01 devstack sudo[102820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:26:01 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:01 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (ccbb9265-c4a7-4b47-871b-78230562aa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd3a3f0-ec7c-45a2-af5a-d802a5338527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd3a3f0-ec7c-45a2-af5a-d802a5338527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314309630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce92a52b-106f-45a8-836d-c0856041537d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:02Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3556fb-cf5f-44ab-a02c-7de7c9542c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3556fb-cf5f-44ab-a02c-7de7c9542c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef6ce56-0688-43de-8688-709aff2b26b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef6ce56-0688-43de-8688-709aff2b26b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce92a52b-106f-45a8-836d-c0856041537d', 'volume_name': 'volume-ce92a52b-106f-45a8-836d-c0856041537d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8548c3d8-10f7-4d5b-a1a5-c7499dcd52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8548c3d8-10f7-4d5b-a1a5-c7499dcd52f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:02 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a7e15f-e291-45e6-abc0-3b067cc7b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Volume ce92a52b-106f-45a8-836d-c0856041537d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce92a52b-106f-45a8-836d-c0856041537d', 'volume_size': 1}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" returned: 0 in 1.268s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-quobyte-53686a46-44f1-40d7-bdf7-9f3a4ff9036c" released by "delete_volume" :: held 5.822s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:02 devstack cinder-volume[92103]: WARNING cinder.quota [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763190933-1052197995 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763190933-1052197995, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:26:02 devstack cinder-volume[92103]: WARNING cinder.quota [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763190933-1052197995 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763190933-1052197995, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Created reservations ['ed864f6a-5898-40ac-a0f3-560af5f675a9', '99b11204-b72e-4b55-8a6a-cfb1e9a6a6a3', '9372f442-4234-46f9-873d-8ef668f25116', 'd86e23cc-29e6-49bc-9c37-ec41e1077c7a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:02 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:02 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:02 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 0.858s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:26:02 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Converted 1024.00 MB image at 149.59 MB/s
Jun 15 04:26:02 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 is being set with open permissions: ugo+rw
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:02 devstack sudo[102829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3
Jun 15 04:26:02 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:02 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Deleted volume successfully.
Jun 15 04:26:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1125e24f-9316-44a1-824c-d5ae90614997 tempest-TestInstancesWithCinderVolumes-1758291406 None] Lock "cinder-53686a46-44f1-40d7-bdf7-9f3a4ff9036c-delete_volume" released by "delete_volume" :: held 6.790s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:03 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3" returned: 0 in 0.601s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-298c98ca-89da-4a5c-a204-c9aab8e252b3" released by "_copy_volume_from_snapshot" :: held 10.280s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-a61964b8-4e8c-443b-952f-aa3f0015d36d-298c98ca-89da-4a5c-a204-c9aab8e252b3" released by "_create_volume_from_snapshot" :: held 10.316s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.345s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314309630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce92a52b-106f-45a8-836d-c0856041537d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:02Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Creating volume ce92a52b-106f-45a8-836d-c0856041537d {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:03 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:03 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d 1073741824
Jun 15 04:26:03 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285ed273-9ad0-4c64-bc22-24c7846f0352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298c98ca-89da-4a5c-a204-c9aab8e252b3', 'volume_size': 1, 'snapshot_id': 'a61964b8-4e8c-443b-952f-aa3f0015d36d'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28de7dcb-8448-400d-b071-eb3e0fa0a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Volume volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 (298c98ca-89da-4a5c-a204-c9aab8e252b3): created successfully
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28de7dcb-8448-400d-b071-eb3e0fa0a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Flow 'volume_create_manager' (115b28eb-34ec-4f22-b75b-2bc582f243ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:03 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-46bdafe0-a736-4d39-9ccb-45f9820b83b8 tempest-VolumesSnapshotTestJSON-189487870 None] Created volume successfully.
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-298c98ca-89da-4a5c-a204-c9aab8e252b3-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:04 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d 1073741824" returned: 0 in 0.972s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-298c98ca-89da-4a5c-a204-c9aab8e252b3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-298c98ca-89da-4a5c-a204-c9aab8e252b3" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-298c98ca-89da-4a5c-a204-c9aab8e252b3" acquired by "delete_volume" :: waited 0.042s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:04 devstack sudo[102838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d
Jun 15 04:26:04 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f3764-6539-4a49-b252-5e4af87cfd0c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:04 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3
Jun 15 04:26:04 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:05 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d" returned: 0 in 0.733s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a7e15f-e291-45e6-abc0-3b067cc7b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce92a52b-106f-45a8-836d-c0856041537d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741f4cfc-72c1-4e37-9b83-ee346d593a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:05 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Volume volume-ce92a52b-106f-45a8-836d-c0856041537d (ce92a52b-106f-45a8-836d-c0856041537d): created successfully
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741f4cfc-72c1-4e37-9b83-ee346d593a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (ccbb9265-c4a7-4b47-871b-78230562aa0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-2625e081-52c5-4653-a1cb-2ec090caf77c tempest-VolumesActionsTest-1538163963 None] Created volume successfully.
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "cinder-5080fb97-96a3-4467-8e24-019aa3669680-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-5080fb97-96a3-4467-8e24-019aa3669680-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "cinder-quobyte-5080fb97-96a3-4467-8e24-019aa3669680" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-quobyte-5080fb97-96a3-4467-8e24-019aa3669680" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48e882-515c-4160-a9d3-2491972b6799]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:05 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3" returned: 0 in 0.972s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:05 devstack sudo[102847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3
Jun 15 04:26:05 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:05 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680
Jun 15 04:26:05 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:06 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-298c98ca-89da-4a5c-a204-c9aab8e252b3" returned: 0 in 0.664s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-298c98ca-89da-4a5c-a204-c9aab8e252b3" released by "delete_volume" :: held 1.689s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:06 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680" returned: 0 in 0.759s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:06 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['83070486-2faf-4785-b3ab-667c9e41ca47', 'ce893cca-917a-456a-828e-ccc010a00eb2', '065ae70b-8d8d-4401-ad96-94af56cdbfec', '89d7cd5f-16e6-4bbb-ad7f-5a0071688fbf'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:06 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:06 devstack sudo[102857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:06 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-ce92a52b-106f-45a8-836d-c0856041537d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-ce92a52b-106f-45a8-836d-c0856041537d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-quobyte-ce92a52b-106f-45a8-836d-c0856041537d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-ce92a52b-106f-45a8-836d-c0856041537d" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-a61964b8-4e8c-443b-952f-aa3f0015d36d-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbc9ba3-ce72-46f5-a14b-2a3ac5bdc52e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-a61964b8-4e8c-443b-952f-aa3f0015d36d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-bc0e46df-0bfc-4578-9911-bb2984321c34" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-bc0e46df-0bfc-4578-9911-bb2984321c34" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-a61964b8-4e8c-443b-952f-aa3f0015d36d" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-a61964b8-4e8c-443b-952f-aa3f0015d36d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Deleting offline snapshot a61964b8-4e8c-443b-952f-aa3f0015d36d of volume bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] snapshot_file for this snap is: volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b669d9c7-dc00-4c77-ad87-11c484264458]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:06 devstack sudo[102859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d
Jun 15 04:26:06 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:06 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5080fb97-96a3-4467-8e24-019aa3669680" returned: 0 in 0.846s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-quobyte-5080fb97-96a3-4467-8e24-019aa3669680" released by "delete_volume" :: held 1.653s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:06 devstack sudo[102862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d
Jun 15 04:26:06 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:07 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.822s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Deleted volume successfully.
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Created reservations ['33480424-aee7-482d-90f1-50ca1bde1e0a', '7287ac72-0275-4af5-90c3-aefc20cf81db', '06466d2f-9bbb-4da8-a304-9449a8c4ae94', 'ccfac5e1-3564-4e58-af04-e183bdd6ab64'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-263f686f-9880-46ec-9693-5ba85337bfbc tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-298c98ca-89da-4a5c-a204-c9aab8e252b3-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:07 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:07 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:07 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "cinder-a46b0729-84f1-4930-a726-eeca7b676194-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d" returned: 0 in 1.011s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-a46b0729-84f1-4930-a726-eeca7b676194-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:07 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d
Jun 15 04:26:07 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "cinder-quobyte-a46b0729-84f1-4930-a726-eeca7b676194" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-quobyte-a46b0729-84f1-4930-a726-eeca7b676194" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c577c82-1535-45c0-97ed-b3203ef65176]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:08 devstack sudo[102876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194
Jun 15 04:26:08 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:08 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d" returned: 0 in 1.280s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e46df-0bfc-4578-9911-bb2984321c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308d61b-298b-4524-a3d0-0d65de4841b0]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:08 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.976s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Deleted volume successfully.
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-44a9ef27-b63a-4257-a9ef-512c72464f21 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-5080fb97-96a3-4467-8e24-019aa3669680-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:08 devstack sudo[102880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:26:08 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:08 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ce92a52b-106f-45a8-836d-c0856041537d" returned: 0 in 0.770s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-ce92a52b-106f-45a8-836d-c0856041537d" released by "delete_volume" :: held 1.872s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Created reservations ['b2ab258d-d5d9-4fe6-aa54-efe651bc8556', '06102791-d7c2-430f-b621-7e2f2520489f', '621e44eb-5b72-4e91-aae3-ce2225d52522', '71f1337b-52e0-4734-8dff-8fd78a376dc6'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:08 devstack sudo[102883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:08 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:09 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194" returned: 0 in 1.137s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:09 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194
Jun 15 04:26:09 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:09 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 0.973s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:09 devstack sudo[102893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d
Jun 15 04:26:09 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (940d4d2b-4316-4f4c-9475-25e54c1197ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff52fac-c870-45d5-9d9a-dfcd3298832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff52fac-c870-45d5-9d9a-dfcd3298832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600424763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25f0430-1937-4884-9a0a-50eb7a050caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:09Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e66eef-2f81-4df9-bd1e-1139995a902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e66eef-2f81-4df9-bd1e-1139995a902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:09 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4c489c-926a-46f5-ad08-3f487ef7d729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4c489c-926a-46f5-ad08-3f487ef7d729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f25f0430-1937-4884-9a0a-50eb7a050caa', 'volume_name': 'volume-f25f0430-1937-4884-9a0a-50eb7a050caa', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da73914-6ee7-4965-8209-92884475f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da73914-6ee7-4965-8209-92884475f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c35836-dfa4-4fb2-8885-dfdcdea7f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:09 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Volume f25f0430-1937-4884-9a0a-50eb7a050caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f25f0430-1937-4884-9a0a-50eb7a050caa', 'volume_size': 1}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600424763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25f0430-1937-4884-9a0a-50eb7a050caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:09Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Creating volume f25f0430-1937-4884-9a0a-50eb7a050caa {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:09 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.943s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:09 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Deleted volume successfully.
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f722420-f43a-4331-b341-b4488d5cb875 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-ce92a52b-106f-45a8-836d-c0856041537d-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:09 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa 1073741824
Jun 15 04:26:09 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:09 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a46b0729-84f1-4930-a726-eeca7b676194" returned: 0 in 0.852s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-quobyte-a46b0729-84f1-4930-a726-eeca7b676194" released by "delete_volume" :: held 2.037s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:09 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Created reservations ['2384d2ac-cda1-45ce-980f-6e251ab19cd9', '3303e2a0-919e-4737-bb21-da0e2bd386b1', 'e8d9288f-086f-4470-9191-69bd467fa31c', '71f13b6c-ff3b-441f-b953-9b343ac31b8d'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:10 devstack sudo[102902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:10 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:10 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d" returned: 0 in 1.021s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:10 devstack sudo[102904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d
Jun 15 04:26:10 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:10 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa 1073741824" returned: 0 in 1.026s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:10 devstack sudo[102912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa
Jun 15 04:26:10 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:10 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.806s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:10 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Deleted volume successfully.
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a3168238-cd9d-4804-9b6c-7cd162206e46 tempest-AttachVolumeShelveTestJSON-2068040000 None] Lock "cinder-a46b0729-84f1-4930-a726-eeca7b676194-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:10 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34.a61964b8-4e8c-443b-952f-aa3f0015d36d" returned: 0 in 0.770s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-a61964b8-4e8c-443b-952f-aa3f0015d36d" released by "_delete_snapshot" :: held 4.185s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-bc0e46df-0bfc-4578-9911-bb2984321c34" released by "delete_snapshot" :: held 4.217s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['11804782-6a0c-410f-b33a-8a5c63f5bcd2', 'ae08b024-4891-401a-9856-2a11a3ec87fa', '62550bbb-ced6-4b94-b344-70c42377bd45', '3340084d-e47f-4366-b424-11bd414894a4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Delete snapshot completed successfully.
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-393277a7-399b-4047-bf43-8b0845cbb850 tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-a61964b8-4e8c-443b-952f-aa3f0015d36d-delete_snapshot" released by "delete_snapshot" :: held 4.391s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:11 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa" returned: 0 in 0.696s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c35836-dfa4-4fb2-8885-dfdcdea7f977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25f0430-1937-4884-9a0a-50eb7a050caa', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54c529c-e002-423c-bb22-a5accefcd819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:11 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Volume volume-f25f0430-1937-4884-9a0a-50eb7a050caa (f25f0430-1937-4884-9a0a-50eb7a050caa): created successfully
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54c529c-e002-423c-bb22-a5accefcd819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (940d4d2b-4316-4f4c-9475-25e54c1197ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-32717dd0-321f-49c6-af49-e3359332893e tempest-VolumesActionsTest-1538163963 None] Created volume successfully.
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-f25f0430-1937-4884-9a0a-50eb7a050caa-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-f25f0430-1937-4884-9a0a-50eb7a050caa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-quobyte-f25f0430-1937-4884-9a0a-50eb7a050caa" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-f25f0430-1937-4884-9a0a-50eb7a050caa" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab6383a-dd26-4a19-93da-4acd20461b81]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:12 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa
Jun 15 04:26:12 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-bc0e46df-0bfc-4578-9911-bb2984321c34-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-bc0e46df-0bfc-4578-9911-bb2984321c34-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-bc0e46df-0bfc-4578-9911-bb2984321c34" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-bc0e46df-0bfc-4578-9911-bb2984321c34" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[34268878-78b1-4bf2-9568-d0d34844e3a0]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:12 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:26:12 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:12 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa" returned: 0 in 0.945s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:12 devstack sudo[102924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa
Jun 15 04:26:12 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:13 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 1.047s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:13 devstack sudo[102930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34
Jun 15 04:26:13 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:13 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f25f0430-1937-4884-9a0a-50eb7a050caa" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-f25f0430-1937-4884-9a0a-50eb7a050caa" released by "delete_volume" :: held 1.707s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Created reservations ['243ca8be-8919-48f6-bf66-183c931b6753', '96b92e8b-8bbe-4576-8f7b-825e5af04a3f', '370fe811-a7ad-4b03-8ba4-02133033fb88', '6e8c41ef-4c2f-4c12-acdb-41467f7fd042'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:13 devstack sudo[102933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:13 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:14 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bc0e46df-0bfc-4578-9911-bb2984321c34" returned: 0 in 0.779s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-bc0e46df-0bfc-4578-9911-bb2984321c34" released by "delete_volume" :: held 1.910s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['2cdbe58c-14a1-4186-a6a0-244d460588f9', '45ffe7a8-f876-4f92-b837-67df5adfc78d', '6c2f25a0-8038-463e-a15b-544390e878fc', 'bd138585-b513-4f9b-a475-4ec998a4d7a7'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:14 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:14 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:14 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-e4fba66a-f810-49d1-8ac1-62762b460d5f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.919s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Deleted volume successfully.
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-e4fba66a-f810-49d1-8ac1-62762b460d5f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ee5fbc75-d71c-4635-a15f-3b78319f308b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-f25f0430-1937-4884-9a0a-50eb7a050caa-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "cinder-quobyte-e4fba66a-f810-49d1-8ac1-62762b460d5f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-e4fba66a-f810-49d1-8ac1-62762b460d5f" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f9952-4d2b-4c14-8785-9aab979b06bd]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (6b3151d2-96a2-4abe-9fb6-da777bcee805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b415a9f-265f-443d-892c-a9e8d0115842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:15 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f
Jun 15 04:26:15 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b415a9f-265f-443d-892c-a9e8d0115842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406629689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc9fee3-991c-4655-becc-dedfa1a9c2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:15Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f63835-accb-4eda-8796-eaeed00e0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f63835-accb-4eda-8796-eaeed00e0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6b443c-5c51-484b-a831-727da6840ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6b443c-5c51-484b-a831-727da6840ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc9fee3-991c-4655-becc-dedfa1a9c2fb', 'volume_name': 'volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edf7178-1651-4594-a8b6-b329f7b3a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edf7178-1651-4594-a8b6-b329f7b3a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965a6b3e-1a44-4b03-b140-1857fd382a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:15 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Volume 0bc9fee3-991c-4655-becc-dedfa1a9c2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb', 'volume_size': 1}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406629689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc9fee3-991c-4655-becc-dedfa1a9c2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:15Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Creating volume 0bc9fee3-991c-4655-becc-dedfa1a9c2fb {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:15 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:15 devstack sudo[102942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb 1073741824
Jun 15 04:26:15 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:15 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.044s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Deleted volume successfully.
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2dbdc17a-0723-4fbe-803e-0e60a690ef3d tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-bc0e46df-0bfc-4578-9911-bb2984321c34-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:15 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f" returned: 0 in 1.004s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:15 devstack sudo[102953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f
Jun 15 04:26:15 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb 1073741824" returned: 0 in 1.068s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:16 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:16 devstack sudo[102956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb
Jun 15 04:26:16 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:16 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4fba66a-f810-49d1-8ac1-62762b460d5f" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-quobyte-e4fba66a-f810-49d1-8ac1-62762b460d5f" released by "delete_volume" :: held 1.938s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Created reservations ['0d808baa-3290-4150-b5c1-2d220741e4f7', '4fc999a5-7e8a-48e6-a19e-71a21befad61', '2460e0da-a0f1-441c-b026-cef9112cfa0e', 'b32e5bed-4c53-4841-8c5a-cd49ac59f776'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:16 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:16 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:17 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb" returned: 0 in 0.813s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965a6b3e-1a44-4b03-b140-1857fd382a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6776442-758c-48ea-9b98-3a15c68f27d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Volume volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb (0bc9fee3-991c-4655-becc-dedfa1a9c2fb): created successfully
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6776442-758c-48ea-9b98-3a15c68f27d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (6b3151d2-96a2-4abe-9fb6-da777bcee805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-372da4ec-8000-43d2-9ced-b0b858e233a7 tempest-VolumesActionsTest-1538163963 None] Created volume successfully.
Jun 15 04:26:17 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.740s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Deleted volume successfully.
Jun 15 04:26:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-25768429-afec-4e19-9fc8-f8f0968806ce tempest-VolumesSnapshotTestJSON-189487870 None] Lock "cinder-e4fba66a-f810-49d1-8ac1-62762b460d5f-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-0bc9fee3-991c-4655-becc-dedfa1a9c2fb-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-0bc9fee3-991c-4655-becc-dedfa1a9c2fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-quobyte-0bc9fee3-991c-4655-becc-dedfa1a9c2fb" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-0bc9fee3-991c-4655-becc-dedfa1a9c2fb" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:18 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a33983-594f-4d74-81fe-6be695db6f89]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:18 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb
Jun 15 04:26:18 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:19 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb" returned: 0 in 0.823s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:19 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb
Jun 15 04:26:19 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:19 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bc9fee3-991c-4655-becc-dedfa1a9c2fb" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-0bc9fee3-991c-4655-becc-dedfa1a9c2fb" released by "delete_volume" :: held 1.593s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Created reservations ['9a860891-46a0-4cff-af17-9c5f526b00c4', '77227a25-3a60-4544-adfa-fa9c71b71a88', '46b295c4-03e1-47e7-94ca-0957ca5d7f1c', 'f5e81cb5-9541-488e-bbb8-0b581a67c718'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:20 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:20 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:21 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.835s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:21 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Deleted volume successfully.
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-89f23047-074a-41c5-9bdc-f5a30d3dc46b tempest-VolumesActionsTest-2039468359 None] Lock "cinder-0bc9fee3-991c-4655-becc-dedfa1a9c2fb-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (64952e43-eb90-48bc-ae99-7ac3f3782882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85669220-abf4-4197-89c6-6ba0de516a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85669220-abf4-4197-89c6-6ba0de516a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1294447027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c3efd0-88fe-48ec-9e71-087679693b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:21Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e560d49f-d045-4723-abbe-9482e2604f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e560d49f-d045-4723-abbe-9482e2604f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7f453d-6d90-45ab-82af-3bc0b1f96cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7f453d-6d90-45ab-82af-3bc0b1f96cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c3efd0-88fe-48ec-9e71-087679693b33', 'volume_name': 'volume-12c3efd0-88fe-48ec-9e71-087679693b33', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95c26a4-17fb-4b8c-8d00-7b9669e012e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95c26a4-17fb-4b8c-8d00-7b9669e012e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bfab40-3430-4d3d-a6b8-919bfffffe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Volume 12c3efd0-88fe-48ec-9e71-087679693b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c3efd0-88fe-48ec-9e71-087679693b33', 'volume_size': 1}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1294447027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c3efd0-88fe-48ec-9e71-087679693b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:21Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Creating volume 12c3efd0-88fe-48ec-9e71-087679693b33 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:21 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:21 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33 1073741824
Jun 15 04:26:21 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:22 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33 1073741824" returned: 0 in 0.884s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:22 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33
Jun 15 04:26:22 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:23 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33" returned: 0 in 0.714s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bfab40-3430-4d3d-a6b8-919bfffffe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c3efd0-88fe-48ec-9e71-087679693b33', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83420803-859a-48f3-9a9f-89c203696ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:23 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Volume volume-12c3efd0-88fe-48ec-9e71-087679693b33 (12c3efd0-88fe-48ec-9e71-087679693b33): created successfully
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83420803-859a-48f3-9a9f-89c203696ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (64952e43-eb90-48bc-ae99-7ac3f3782882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-143c3764-0aef-42e1-baef-5a782baeaa98 tempest-VolumesActionsTest-1538163963 None] Created volume successfully.
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-12c3efd0-88fe-48ec-9e71-087679693b33-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-12c3efd0-88fe-48ec-9e71-087679693b33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "cinder-quobyte-12c3efd0-88fe-48ec-9e71-087679693b33" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-12c3efd0-88fe-48ec-9e71-087679693b33" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f490031-b130-4ead-8a91-e71f5d942708]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:23 devstack sudo[102988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33
Jun 15 04:26:23 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:24 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33" returned: 0 in 0.826s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:24 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33
Jun 15 04:26:24 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:25 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-12c3efd0-88fe-48ec-9e71-087679693b33" returned: 0 in 0.701s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-quobyte-12c3efd0-88fe-48ec-9e71-087679693b33" released by "delete_volume" :: held 1.589s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Created reservations ['c2879852-1a9d-4888-864f-9b9628811159', '96ebcf34-50e2-45db-86f5-dda4d0b9a452', '2c2ee0e0-d641-4ef9-8dee-8916ce489dd5', '04ece7ed-788c-41b9-a4a9-a424d06a91de'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:25 devstack sudo[103003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:25 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:26 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.906s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:26 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:26 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Deleted volume successfully.
Jun 15 04:26:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6054ded1-a0e5-45dd-8088-877e74628203 tempest-VolumesActionsTest-2039468359 None] Lock "cinder-12c3efd0-88fe-48ec-9e71-087679693b33-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:26 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (b257bbb9-a197-4512-bb42-1772296384fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a7dfc0-19bb-4119-84eb-835c501aa4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a7dfc0-19bb-4119-84eb-835c501aa4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-243126771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718421f0-7a33-4315-a821-0c0c225ecdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:27Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e371b5c-af1b-492f-9294-0f5c11d4ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e371b5c-af1b-492f-9294-0f5c11d4ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b48242-e6fc-4dce-bea4-46c8b8a13724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b48242-e6fc-4dce-bea4-46c8b8a13724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718421f0-7a33-4315-a821-0c0c225ecdcc', 'volume_name': 'volume-718421f0-7a33-4315-a821-0c0c225ecdcc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9340b114-c934-485f-8478-240d0ca4b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9340b114-c934-485f-8478-240d0ca4b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc2e04a-37c3-46ae-ba78-b7137d3db2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Volume 718421f0-7a33-4315-a821-0c0c225ecdcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718421f0-7a33-4315-a821-0c0c225ecdcc', 'volume_size': 1}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-243126771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718421f0-7a33-4315-a821-0c0c225ecdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2842bcfb7901420487d68bd5e1de8de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:27Z,use_quota=True,user_id='30b27887df6049749353c4f755aa73bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Creating volume 718421f0-7a33-4315-a821-0c0c225ecdcc {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:27 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:27 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc 1073741824
Jun 15 04:26:27 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=136,cinder:UPDATE=167,cinder:INSERT=30,cinder:DELETE=7 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=151,cinder:DELETE=17,cinder:SELECT=98,cinder:INSERT=47 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Flow 'volume_create_manager' (10c5fde3-b4ff-4a19-ac9a-1ec4c644fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdeb59e-2fea-4862-aa56-5e3c96542153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdeb59e-2fea-4862-aa56-5e3c96542153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2031407110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66170e3c-c90c-4dc6-861c-c6897bda3e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636aad0c5cb4ac8bff9a861dcd58489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:28Z,use_quota=True,user_id='831848bf2a404e768be4df2c3a8e5160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c814a5b-81b0-418b-a2c1-1234a722754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c814a5b-81b0-418b-a2c1-1234a722754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3417998d-60cf-4429-b75f-df9410c72850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3417998d-60cf-4429-b75f-df9410c72850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66170e3c-c90c-4dc6-861c-c6897bda3e5d', 'volume_name': 'volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16af74a8-dbbd-4473-ae56-0fe0222418b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16af74a8-dbbd-4473-ae56-0fe0222418b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3af07b6-0a01-4635-99e3-5949c1889d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d', 'volume_size': 1}
Jun 15 04:26:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:28 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc 1073741824" returned: 0 in 1.132s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:28 devstack sudo[103014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc
Jun 15 04:26:28 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:28 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc" returned: 0 in 0.681s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2031407110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66170e3c-c90c-4dc6-861c-c6897bda3e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3636aad0c5cb4ac8bff9a861dcd58489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:28Z,use_quota=True,user_id='831848bf2a404e768be4df2c3a8e5160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Creating volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:29 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc2e04a-37c3-46ae-ba78-b7137d3db2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718421f0-7a33-4315-a821-0c0c225ecdcc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1c9ae2-036b-44a3-be91-6677c3597780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Volume volume-718421f0-7a33-4315-a821-0c0c225ecdcc (718421f0-7a33-4315-a821-0c0c225ecdcc): created successfully
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1c9ae2-036b-44a3-be91-6677c3597780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Flow 'volume_create_manager' (b257bbb9-a197-4512-bb42-1772296384fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:29 devstack sudo[103017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d 1073741824
Jun 15 04:26:29 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a4c7fb4d-457c-4f2c-bb4f-6e499d7c5fa2 tempest-VolumesActionsTest-1538163963 None] Created volume successfully.
Jun 15 04:26:29 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d 1073741824" returned: 0 in 0.922s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:30 devstack sudo[103023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d
Jun 15 04:26:30 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:30 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d" returned: 0 in 0.831s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3af07b6-0a01-4635-99e3-5949c1889d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18ba6a7-23e1-45ad-9b7b-96c18457faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Volume volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d (66170e3c-c90c-4dc6-861c-c6897bda3e5d): created successfully
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18ba6a7-23e1-45ad-9b7b-96c18457faf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Flow 'volume_create_manager' (10c5fde3-b4ff-4a19-ac9a-1ec4c644fd82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ac23c041-72b5-43fb-8ea7-3b291692aa80 tempest-VolumesSnapshotListTestJSON-820802011 None] Created volume successfully.
Jun 15 04:26:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Acquiring lock "cinder-718421f0-7a33-4315-a821-0c0c225ecdcc-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Lock "cinder-718421f0-7a33-4315-a821-0c0c225ecdcc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Acquiring lock "cinder-quobyte-718421f0-7a33-4315-a821-0c0c225ecdcc" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Lock "cinder-quobyte-718421f0-7a33-4315-a821-0c0c225ecdcc" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:31 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e87510-79dd-4c14-b8a7-6d96acf493cb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:31 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc
Jun 15 04:26:31 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:32 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc" returned: 0 in 0.840s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:32 devstack sudo[103032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc
Jun 15 04:26:32 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Creating offline snapshot 5ca8cdee-47b5-4657-b3fb-fb351169c351 of volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd911f55-07fe-46b0-b3c2-dad446c45199]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:32 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d
Jun 15 04:26:32 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:32 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-718421f0-7a33-4315-a821-0c0c225ecdcc" returned: 0 in 0.750s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Lock "cinder-quobyte-718421f0-7a33-4315-a821-0c0c225ecdcc" released by "delete_volume" :: held 1.657s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:32 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Created reservations ['3fd23f33-57d8-4838-85c0-bb11de1ca7c3', '0c110be2-d924-4e09-9420-94f69b9e7839', '8fb184a0-9243-4cd0-8353-73568c7032f2', 'de702b3e-7ad2-4b1f-bbd9-04d9c150f6f3'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:33 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:33 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:33 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d" returned: 0 in 1.003s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:33 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 1G
Jun 15 04:26:33 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:33 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.774s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:33 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Deleted volume successfully.
Jun 15 04:26:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55094caa-afee-49ac-8309-4bf59febbabc tempest-VolumesActionsTest-1538163963 None] Lock "cinder-718421f0-7a33-4315-a821-0c0c225ecdcc-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:34 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 1G" returned: 0 in 1.040s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:34 devstack sudo[103049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:26:34 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:35 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 0.702s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:35 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 is being set with open permissions: ugo+rw
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:35 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:26:35 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:35 devstack sudo[103057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:26:35 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:35 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 0.831s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:36 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info
Jun 15 04:26:36 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:36 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.783s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:26:36 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info" returned: 0 in 0.723s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:36 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info is being set with open permissions: ugo+rw
Jun 15 04:26:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:36 devstack sudo[103064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info
Jun 15 04:26:36 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:37 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.info" returned: 0 in 0.748s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.162s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9b4c19e0-8fda-448f-a1d4-af8e4be09366 tempest-VolumesSnapshotListTestJSON-820802011 None] Create snapshot completed successfully
Jun 15 04:26:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Creating offline snapshot cb363255-c122-4372-86a3-d068f50e2d8a of volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:26:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f3c17-18c6-4582-a9d8-5c572814906e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:39 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:26:39 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:39 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 0.775s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:39 devstack sudo[103074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a 1G
Jun 15 04:26:39 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:40 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a 1G" returned: 0 in 1.180s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:41 devstack sudo[103117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:41 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:41 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.739s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:41 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a is being set with open permissions: ugo+rw
Jun 15 04:26:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:41 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:41 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:42 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.713s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.557s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8216cf32-61d5-4e44-a4e9-0ec14ec04c5b tempest-VolumesSnapshotListTestJSON-820802011 None] Create snapshot completed successfully
Jun 15 04:26:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Creating offline snapshot d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd of volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:26:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[df31d979-ae33-4f50-97d4-6bf3e0d62d31]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:43 devstack sudo[103127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:43 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:44 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.826s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:44 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd 1G
Jun 15 04:26:44 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:45 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd 1G" returned: 0 in 0.916s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:45 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd
Jun 15 04:26:45 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:45 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" returned: 0 in 0.676s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:45 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd is being set with open permissions: ugo+rw
Jun 15 04:26:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:45 devstack sudo[103145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd
Jun 15 04:26:45 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:46 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7079dd85-78e0-4b4f-802d-aa7db1b44f9d tempest-VolumesSnapshotListTestJSON-820802011 None] Create snapshot completed successfully
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Deleting offline snapshot d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd of volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] snapshot_file for this snap is: volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18e681-25c1-470d-8535-cf96c3bcbaeb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:49 devstack sudo[103155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd
Jun 15 04:26:49 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:50 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" returned: 0 in 0.944s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7c9c47-8f9e-4714-ab19-dc4eba18a8c6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:50 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:50 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:50 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.761s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:50 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd
Jun 15 04:26:50 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:51 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" returned: 0 in 0.843s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:51 devstack sudo[103173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd
Jun 15 04:26:51 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:52 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd" released by "_delete_snapshot" :: held 3.318s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" released by "delete_snapshot" :: held 3.340s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:52 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Created reservations ['d35eb11d-3952-43e6-8f1e-3f0b0018be42', 'eba0a07a-8fbe-4641-b7bd-bdbcbabcdfff', '88c979a8-b232-4b55-bf85-750b87cc9445', 'f843a51c-4d23-44e5-837e-830c9ff2761a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Delete snapshot completed successfully.
Jun 15 04:26:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1c7b220b-3a49-42c5-81da-744f70fe73b3 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-d7c0bd8a-7c1f-4d52-b3a7-88e657e164cd-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-cb363255-c122-4372-86a3-d068f50e2d8a-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-cb363255-c122-4372-86a3-d068f50e2d8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-cb363255-c122-4372-86a3-d068f50e2d8a" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-cb363255-c122-4372-86a3-d068f50e2d8a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Deleting offline snapshot cb363255-c122-4372-86a3-d068f50e2d8a of volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] snapshot_file for this snap is: volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[83de9cd2-5374-4a9a-bc06-664a1641b05f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:53 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:53 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Flow 'volume_create_manager' (bee0429e-8e36-4fb2-b77c-1f2180e84d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf95dad9-fa1c-4c25-9cae-cba73b602e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf95dad9-fa1c-4c25-9cae-cba73b602e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-684867577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae3154c-2de5-4496-b61e-51db2b9f9d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a083d289ad4b549f55761d05a3ee29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:54Z,use_quota=True,user_id='6aa20b2aa41d4ee389950fd8354e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02739e4a-5e0b-44b6-99d5-1990b70d56e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02739e4a-5e0b-44b6-99d5-1990b70d56e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7315dd0b-8511-4c3f-b2a3-7f0e29dae70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7315dd0b-8511-4c3f-b2a3-7f0e29dae70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae3154c-2de5-4496-b61e-51db2b9f9d61', 'volume_name': 'volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbffb254-8fd1-446f-9c09-1bece71cbd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbffb254-8fd1-446f-9c09-1bece71cbd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b48dd-9265-4536-bf1a-b60388bb77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:53 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Volume 4ae3154c-2de5-4496-b61e-51db2b9f9d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61', 'volume_size': 1}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-684867577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae3154c-2de5-4496-b61e-51db2b9f9d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a083d289ad4b549f55761d05a3ee29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:54Z,use_quota=True,user_id='6aa20b2aa41d4ee389950fd8354e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Creating volume 4ae3154c-2de5-4496-b61e-51db2b9f9d61 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:53 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:53 devstack sudo[103178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 1073741824
Jun 15 04:26:53 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:54 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.948s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e2c97-ff63-4e5c-9894-a613f26dea34]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:54 devstack sudo[103188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:26:54 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:55 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 1073741824" returned: 0 in 1.189s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:55 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61
Jun 15 04:26:55 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:55 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 1.172s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:55 devstack sudo[103213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:55 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:56 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61" returned: 0 in 0.963s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b48dd-9265-4536-bf1a-b60388bb77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f172ff-6a99-4011-9d57-c0e5f66b9153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:56 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Volume volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 (4ae3154c-2de5-4496-b61e-51db2b9f9d61): created successfully
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f172ff-6a99-4011-9d57-c0e5f66b9153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Flow 'volume_create_manager' (bee0429e-8e36-4fb2-b77c-1f2180e84d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:56 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fd1a9a55-0b56-443e-8de1-f77637fbebb5 tempest-VolumesListAdminTestJSON-998947446 None] Created volume successfully.
Jun 15 04:26:56 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.902s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:56 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a
Jun 15 04:26:56 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:57 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.cb363255-c122-4372-86a3-d068f50e2d8a" returned: 0 in 0.834s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-cb363255-c122-4372-86a3-d068f50e2d8a" released by "_delete_snapshot" :: held 4.069s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" released by "delete_snapshot" :: held 4.115s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Created reservations ['f5f8f83b-fdb5-4172-842b-5ea34cfc86b1', '0d2447bb-ebf1-428e-9c0b-de1f3360ac97', '88a248ab-97f0-465a-846f-6ca70ddbc372', 'f2d6bb48-69ca-4b92-aba7-d1b03bf2c584'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Flow 'volume_create_manager' (37495579-3ff8-4e4d-8ef4-d0c3d3150dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1435de17-1440-41dd-ad53-d9d1e4635f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1435de17-1440-41dd-ad53-d9d1e4635f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1626423701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8abccf-04cc-4bb6-a924-c74671c72810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a083d289ad4b549f55761d05a3ee29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:58Z,use_quota=True,user_id='6aa20b2aa41d4ee389950fd8354e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74de5628-b133-4074-9d40-6689dd4a41d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74de5628-b133-4074-9d40-6689dd4a41d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e5102f-d470-4dc7-95cd-60e20b10f4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e5102f-d470-4dc7-95cd-60e20b10f4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8abccf-04cc-4bb6-a924-c74671c72810', 'volume_name': 'volume-6a8abccf-04cc-4bb6-a924-c74671c72810', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f615f914-6ce1-4daf-8464-42c195fa1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f615f914-6ce1-4daf-8464-42c195fa1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4be38d-cf56-4c8d-ba63-c5296ca24688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Volume 6a8abccf-04cc-4bb6-a924-c74671c72810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8abccf-04cc-4bb6-a924-c74671c72810', 'volume_size': 1}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1626423701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8abccf-04cc-4bb6-a924-c74671c72810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a083d289ad4b549f55761d05a3ee29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:26:58Z,use_quota=True,user_id='6aa20b2aa41d4ee389950fd8354e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Creating volume 6a8abccf-04cc-4bb6-a924-c74671c72810 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:26:57 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:57 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810 1073741824
Jun 15 04:26:57 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Delete snapshot completed successfully.
Jun 15 04:26:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5c6724c0-3d48-4ec0-8235-09472df7ace2 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-cb363255-c122-4372-86a3-d068f50e2d8a-delete_snapshot" released by "delete_snapshot" :: held 4.480s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:26:58 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810 1073741824" returned: 0 in 0.853s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-5ca8cdee-47b5-4657-b3fb-fb351169c351-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-5ca8cdee-47b5-4657-b3fb-fb351169c351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:58 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810
Jun 15 04:26:58 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-5ca8cdee-47b5-4657-b3fb-fb351169c351" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-5ca8cdee-47b5-4657-b3fb-fb351169c351" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Deleting offline snapshot 5ca8cdee-47b5-4657-b3fb-fb351169c351 of volume 66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] snapshot_file for this snap is: volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53f9ada-50d2-4ad8-8cf0-25a052831e31]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:58 devstack sudo[103256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:26:58 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:26:59 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810" returned: 0 in 0.667s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4be38d-cf56-4c8d-ba63-c5296ca24688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8abccf-04cc-4bb6-a924-c74671c72810', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062e5b18-c2b4-4665-8a1d-4062be813ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:26:59 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Volume volume-6a8abccf-04cc-4bb6-a924-c74671c72810 (6a8abccf-04cc-4bb6-a924-c74671c72810): created successfully
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062e5b18-c2b4-4665-8a1d-4062be813ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Flow 'volume_create_manager' (37495579-3ff8-4e4d-8ef4-d0c3d3150dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:26:59 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cabc7b76-57a2-4136-bd9e-92dae3effe6a tempest-VolumesListAdminTestJSON-998947446 None] Created volume successfully.
Jun 15 04:26:59 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 0.773s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5140977-1879-4379-8a6b-4758eb6c8b02]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:26:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:26:59 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d
Jun 15 04:26:59 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Flow 'volume_create_manager' (882c9f36-8a0d-4354-9611-0b36b291feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e762b1-5af0-419c-8d64-2e9e84d4ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e762b1-5af0-419c-8d64-2e9e84d4ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1530430341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ce2ff0-3555-4d96-b60b-4bc6489b31c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a083d289ad4b549f55761d05a3ee29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:00Z,use_quota=True,user_id='6aa20b2aa41d4ee389950fd8354e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d351f6d-b132-4f39-a6e3-3934c2b579b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d351f6d-b132-4f39-a6e3-3934c2b579b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3c650c-7896-486d-8285-36ca2825c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3c650c-7896-486d-8285-36ca2825c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ce2ff0-3555-4d96-b60b-4bc6489b31c8', 'volume_name': 'volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9eb2984-3554-4482-abb3-c9e228b0d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9eb2984-3554-4482-abb3-c9e228b0d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fa69fa-1fad-4139-aff3-0f0e687b175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Volume 78ce2ff0-3555-4d96-b60b-4bc6489b31c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8', 'volume_size': 1}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1530430341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ce2ff0-3555-4d96-b60b-4bc6489b31c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a083d289ad4b549f55761d05a3ee29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:00Z,use_quota=True,user_id='6aa20b2aa41d4ee389950fd8354e7732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Creating volume 78ce2ff0-3555-4d96-b60b-4bc6489b31c8 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:00 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:00 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 1073741824
Jun 15 04:27:00 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:00 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d" returned: 0 in 0.763s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:00 devstack sudo[103273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:27:00 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:01 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 1.317s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:01 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351
Jun 15 04:27:01 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:01 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 1073741824" returned: 0 in 1.464s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:01 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8
Jun 15 04:27:01 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:02 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d.5ca8cdee-47b5-4657-b3fb-fb351169c351" returned: 0 in 0.736s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-5ca8cdee-47b5-4657-b3fb-fb351169c351" released by "_delete_snapshot" :: held 3.705s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" released by "delete_snapshot" :: held 3.733s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Created reservations ['8aefe954-6d61-4ef5-80fb-3a7744ae3e8d', 'e1e86791-c86f-4f8c-99bc-7d8bc2236e2a', '06054237-6fc0-4054-95c2-cbdc2fbe76e9', '10625152-63c6-4cfb-b880-fec4d6585d38'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:02 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8" returned: 0 in 0.706s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fa69fa-1fad-4139-aff3-0f0e687b175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e7e607-ebb0-4674-a1c3-26ff791b1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Volume volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 (78ce2ff0-3555-4d96-b60b-4bc6489b31c8): created successfully
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e7e607-ebb0-4674-a1c3-26ff791b1357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Flow 'volume_create_manager' (882c9f36-8a0d-4354-9611-0b36b291feb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1f57af21-953f-442d-9a70-a1b9cdccbe67 tempest-VolumesListAdminTestJSON-998947446 None] Created volume successfully.
Jun 15 04:27:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Delete snapshot completed successfully.
Jun 15 04:27:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5eb901c4-764a-4412-b8ec-a39205425a26 tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-5ca8cdee-47b5-4657-b3fb-fb351169c351-delete_snapshot" released by "delete_snapshot" :: held 3.972s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-66170e3c-c90c-4dc6-861c-c6897bda3e5d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-66170e3c-c90c-4dc6-861c-c6897bda3e5d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" acquired by "delete_volume" :: waited 0.040s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ff3d9-7291-425a-9f40-a783a4bd5545]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:03 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d
Jun 15 04:27:03 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Flow 'volume_create_manager' (ca302e15-55f7-4588-8a95-e02a0d66db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90febc9-d6d8-4b9e-8db9-9697e4fcb28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90febc9-d6d8-4b9e-8db9-9697e4fcb28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28fead4-329f-40ea-81ab-5ab5516e1b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3354ab149a0b4a6b8ad881c397c263be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:05Z,use_quota=True,user_id='1014ada0d97c433988a3fc1326a6eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a62d8f3-b60b-426e-b95e-acda82730551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a62d8f3-b60b-426e-b95e-acda82730551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86636020-6f39-4e8a-b9af-a8f7ea38e890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86636020-6f39-4e8a-b9af-a8f7ea38e890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28fead4-329f-40ea-81ab-5ab5516e1b0c', 'volume_name': 'volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfccc8dc-e0c3-48b5-a4f9-13604ddca747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfccc8dc-e0c3-48b5-a4f9-13604ddca747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac7aa47-1285-4470-9de0-edc2dc63b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Volume f28fead4-329f-40ea-81ab-5ab5516e1b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c', 'volume_size': 1}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28fead4-329f-40ea-81ab-5ab5516e1b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3354ab149a0b4a6b8ad881c397c263be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:05Z,use_quota=True,user_id='1014ada0d97c433988a3fc1326a6eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Creating volume f28fead4-329f-40ea-81ab-5ab5516e1b0c {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:04 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:05 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c 1073741824
Jun 15 04:27:05 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:05 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d" returned: 0 in 1.546s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:05 devstack sudo[103425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d
Jun 15 04:27:05 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:06 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-66170e3c-c90c-4dc6-861c-c6897bda3e5d" returned: 0 in 0.971s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-quobyte-66170e3c-c90c-4dc6-861c-c6897bda3e5d" released by "delete_volume" :: held 2.644s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Created reservations ['a695a4a8-b334-4531-b086-12d486b689bc', '5dabd7a7-6488-421e-b624-fae10c875ebb', '9f6f7f40-d913-4e68-aa78-760ba26afa37', 'bc13e69a-9e24-4ab8-83d6-45abd22587ec'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:06 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:06 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:06 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c 1073741824" returned: 0 in 1.865s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:07 devstack sudo[103434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c
Jun 15 04:27:07 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:08 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c" returned: 0 in 1.051s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] <== create_volume: return (3040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.045s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac7aa47-1285-4470-9de0-edc2dc63b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6617145d-745a-48f0-a88d-93332564f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Volume volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c (f28fead4-329f-40ea-81ab-5ab5516e1b0c): created successfully
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6617145d-745a-48f0-a88d-93332564f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Flow 'volume_create_manager' (ca302e15-55f7-4588-8a95-e02a0d66db5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ea24aab5-8ed2-4a75-8e1a-fe4ccd4afaa1 tempest-VolumesListAdminTestJSON-527735594 None] Created volume successfully.
Jun 15 04:27:08 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.865s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Deleted volume successfully.
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e1acebe1-7622-4eb4-81f7-35d17e4e95ba tempest-VolumesSnapshotListTestJSON-820802011 None] Lock "cinder-66170e3c-c90c-4dc6-861c-c6897bda3e5d-delete_volume" released by "delete_volume" :: held 5.096s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Acquiring lock "cinder-f28fead4-329f-40ea-81ab-5ab5516e1b0c-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Lock "cinder-f28fead4-329f-40ea-81ab-5ab5516e1b0c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Acquiring lock "cinder-quobyte-f28fead4-329f-40ea-81ab-5ab5516e1b0c" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Lock "cinder-quobyte-f28fead4-329f-40ea-81ab-5ab5516e1b0c" acquired by "delete_volume" :: waited 0.046s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc096d-bad9-49af-8c4f-11d378b60539]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "cinder-78ce2ff0-3555-4d96-b60b-4bc6489b31c8-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-78ce2ff0-3555-4d96-b60b-4bc6489b31c8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "cinder-quobyte-78ce2ff0-3555-4d96-b60b-4bc6489b31c8" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-quobyte-78ce2ff0-3555-4d96-b60b-4bc6489b31c8" acquired by "delete_volume" :: waited 0.038s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:09 devstack sudo[103440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c
Jun 15 04:27:09 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:09 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02bd772-b340-4779-8ad8-50b48094ce3d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:09 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8
Jun 15 04:27:09 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:10 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c" returned: 0 in 1.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:10 devstack sudo[103450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c
Jun 15 04:27:10 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:11 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8" returned: 0 in 2.113s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:11 devstack sudo[103455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8
Jun 15 04:27:11 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:12 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f28fead4-329f-40ea-81ab-5ab5516e1b0c" returned: 0 in 1.805s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Lock "cinder-quobyte-f28fead4-329f-40ea-81ab-5ab5516e1b0c" released by "delete_volume" :: held 3.522s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:12 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-78ce2ff0-3555-4d96-b60b-4bc6489b31c8" returned: 0 in 1.016s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-quobyte-78ce2ff0-3555-4d96-b60b-4bc6489b31c8" released by "delete_volume" :: held 3.240s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Created reservations ['c05e8e87-a0b4-4263-a6fd-6b643d170bf4', '5e2a41c6-4308-40e6-bf64-d041dd1e1004', 'b74d6814-8520-4354-b3ba-078d51de9256', '248c0b15-4c44-4fb4-a71e-70d719a3f2a9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Created reservations ['50813ed8-7b32-43ab-8fbd-9d2f514cef52', '3cee7211-8b81-47ba-a2f0-aadd90a3ce21', '04c307b1-555c-43d5-9876-0e8a0c021c71', 'f97db477-fea7-48ff-8adb-757e97212968'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:12 devstack sudo[103459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:12 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:12 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:12 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:13 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.724s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Deleted volume successfully.
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-2984a227-5fdc-4291-843c-aa462f8c4d3f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-78ce2ff0-3555-4d96-b60b-4bc6489b31c8-delete_volume" released by "delete_volume" :: held 4.493s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:13 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.979s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Deleted volume successfully.
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-65b2343c-3b07-4c07-8f2c-c95f326f480f tempest-VolumesListAdminTestJSON-527735594 None] Lock "cinder-f28fead4-329f-40ea-81ab-5ab5516e1b0c-delete_volume" released by "delete_volume" :: held 5.034s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "cinder-6a8abccf-04cc-4bb6-a924-c74671c72810-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-6a8abccf-04cc-4bb6-a924-c74671c72810-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "cinder-quobyte-6a8abccf-04cc-4bb6-a924-c74671c72810" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-quobyte-6a8abccf-04cc-4bb6-a924-c74671c72810" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:14 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd2300-8479-489e-a74f-a9896cc58159]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:14 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810
Jun 15 04:27:14 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:15 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810" returned: 0 in 1.007s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:15 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810
Jun 15 04:27:15 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:16 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6a8abccf-04cc-4bb6-a924-c74671c72810" returned: 0 in 0.858s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-quobyte-6a8abccf-04cc-4bb6-a924-c74671c72810" released by "delete_volume" :: held 1.940s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Created reservations ['705aa775-9b15-445d-8fcc-c72fc1a1628b', '28b54203-21f3-4a01-9d78-a51e35f1374d', '0fc9f718-2508-4a8c-b249-84eab929632f', '0e7769f5-5ad4-45eb-96a8-2eeb20a3d6d7'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:16 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:16 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "cinder-4ae3154c-2de5-4496-b61e-51db2b9f9d61-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-4ae3154c-2de5-4496-b61e-51db2b9f9d61-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "cinder-quobyte-4ae3154c-2de5-4496-b61e-51db2b9f9d61" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-quobyte-4ae3154c-2de5-4496-b61e-51db2b9f9d61" acquired by "delete_volume" :: waited 0.032s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae465a1-dfce-4d10-9777-0aff173acd33]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:17 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61
Jun 15 04:27:17 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:17 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.148s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:17 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Deleted volume successfully.
Jun 15 04:27:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6996fdab-cdc3-4e22-ab2a-a784e18a6f5b tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-6a8abccf-04cc-4bb6-a924-c74671c72810-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:17 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61" returned: 0 in 0.887s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:17 devstack sudo[103513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61
Jun 15 04:27:17 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:18 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-4ae3154c-2de5-4496-b61e-51db2b9f9d61" returned: 0 in 0.704s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-quobyte-4ae3154c-2de5-4496-b61e-51db2b9f9d61" released by "delete_volume" :: held 1.668s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Created reservations ['1cedfc54-3e3b-41e9-a296-77c97fc08784', 'a44a3727-b617-48dc-a763-aed09770255f', '53a5db98-675d-412f-b2ac-3150dac10be2', 'cf85be25-e1a1-4286-885d-133a98caf4d4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:18 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:18 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:19 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.656s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:19 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Deleted volume successfully.
Jun 15 04:27:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad602a22-eb97-4cf4-8164-5967e8b6675f tempest-VolumesListAdminTestJSON-998947446 None] Lock "cinder-4ae3154c-2de5-4496-b61e-51db2b9f9d61-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:28 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=65,cinder:UPDATE=88,cinder:INSERT=17,cinder:DELETE=9 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=62,cinder:UPDATE=82,cinder:INSERT=26,cinder:DELETE=6 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Flow 'volume_create_manager' (88fad259-ce08-4692-bdf3-73a7f7f7b787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714bf2b6-3568-4502-9102-269fcac78323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714bf2b6-3568-4502-9102-269fcac78323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1261226377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ece12a1-5411-4aad-b1e9-a4d37cf46f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e006e709724d699f373d1fab14dcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:29Z,use_quota=True,user_id='b79bf1e1076b40ffaac257da18d9dda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6288b7-b8e2-4d67-b9d8-1dda74e417f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6288b7-b8e2-4d67-b9d8-1dda74e417f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b17dfe1-6053-4c08-ab4e-972ef739bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b17dfe1-6053-4c08-ab4e-972ef739bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ece12a1-5411-4aad-b1e9-a4d37cf46f69', 'volume_name': 'volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d90153e-8848-49f3-98cf-d2d19af63156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d90153e-8848-49f3-98cf-d2d19af63156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a68315-a236-4c5c-a2fa-b6f24da3a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Volume 9ece12a1-5411-4aad-b1e9-a4d37cf46f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69', 'volume_size': 1}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1261226377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ece12a1-5411-4aad-b1e9-a4d37cf46f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e006e709724d699f373d1fab14dcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:29Z,use_quota=True,user_id='b79bf1e1076b40ffaac257da18d9dda4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Creating volume 9ece12a1-5411-4aad-b1e9-a4d37cf46f69 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:29 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:29 devstack sudo[103551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 1073741824
Jun 15 04:27:29 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Flow 'volume_create_manager' (8706a55d-887e-4ccf-8113-a210cd0eec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d090c198-1d59-4ddb-919b-fb59fcc56ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d090c198-1d59-4ddb-919b-fb59fcc56ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-897968280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daff177aafd045f7950b60942eb0811a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:30Z,use_quota=True,user_id='b9104c0d8c8d4a6abbeaa51e07c5d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93b4a31-e8e5-4b9d-a67c-cfe8d2a8789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93b4a31-e8e5-4b9d-a67c-cfe8d2a8789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae69164-5814-468e-b3c6-44dc5a0e7c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae69164-5814-468e-b3c6-44dc5a0e7c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6', 'volume_name': 'volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc45620-bbd7-4199-abbd-009cb0872f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc45620-bbd7-4199-abbd-009cb0872f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9899cc9-45d5-496b-bf33-74775cf7fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Volume 79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6', 'volume_size': 1}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Flow 'volume_create_manager' (e54646b5-7919-42e9-a2ab-5e0a75f21b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfe58ff-526c-4b92-bb71-e4e4e5b374be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfe58ff-526c-4b92-bb71-e4e4e5b374be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1645150394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee704df-583b-48e8-8150-c5c7ef84483d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0029743a845647789425c17cf697f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:31Z,use_quota=True,user_id='e6110f5b1c6c4dfd8e51b202d53c7f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46f2fdb-54a3-4aae-8e36-afa214c45e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46f2fdb-54a3-4aae-8e36-afa214c45e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca971ce-af17-4d93-af18-815b6f927c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca971ce-af17-4d93-af18-815b6f927c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee704df-583b-48e8-8150-c5c7ef84483d', 'volume_name': 'volume-5ee704df-583b-48e8-8150-c5c7ef84483d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ea1746-a67f-4106-9c22-559fd5a83fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ea1746-a67f-4106-9c22-559fd5a83fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91aca4d7-2c5d-4567-9700-e67d7d3ae932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Volume 5ee704df-583b-48e8-8150-c5c7ef84483d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee704df-583b-48e8-8150-c5c7ef84483d', 'volume_size': 1}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:30 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 1073741824" returned: 0 in 1.043s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:30 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69
Jun 15 04:27:30 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:31 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" returned: 0 in 0.667s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-897968280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daff177aafd045f7950b60942eb0811a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:30Z,use_quota=True,user_id='b9104c0d8c8d4a6abbeaa51e07c5d74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Creating volume 79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:31 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a68315-a236-4c5c-a2fa-b6f24da3a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:31 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 1073741824
Jun 15 04:27:31 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4328be10-9ea0-49a7-9a24-e5ab0d89cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:31 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Volume volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 (9ece12a1-5411-4aad-b1e9-a4d37cf46f69): created successfully
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4328be10-9ea0-49a7-9a24-e5ab0d89cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:31 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Flow 'volume_create_manager' (88fad259-ce08-4692-bdf3-73a7f7f7b787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:31 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-08c9b98a-9383-40b5-9a76-477da9bbbf15 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Created volume successfully.
Jun 15 04:27:32 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 1073741824" returned: 0 in 0.959s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:32 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6
Jun 15 04:27:32 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:33 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6" returned: 0 in 0.628s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.346s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1645150394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee704df-583b-48e8-8150-c5c7ef84483d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0029743a845647789425c17cf697f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:31Z,use_quota=True,user_id='e6110f5b1c6c4dfd8e51b202d53c7f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Creating volume 5ee704df-583b-48e8-8150-c5c7ef84483d {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:33 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:33 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d 1073741824
Jun 15 04:27:33 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9899cc9-45d5-496b-bf33-74775cf7fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8bf35c7-e672-44cc-b6be-8faa0a8dcc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:33 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Volume volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 (79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6): created successfully
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8bf35c7-e672-44cc-b6be-8faa0a8dcc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Flow 'volume_create_manager' (8706a55d-887e-4ccf-8113-a210cd0eec58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:33 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0a0cc3f5-55bd-4ed3-a777-0ea6ea8c65f7 tempest-AbsoluteLimitsTests-2115146295 None] Created volume successfully.
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Acquiring lock "cinder-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Lock "cinder-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Acquiring lock "cinder-quobyte-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Lock "cinder-quobyte-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cae87c-8b17-4cc6-8caf-7b7907c2f489]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:34 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6
Jun 15 04:27:34 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:34 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d 1073741824" returned: 0 in 0.960s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:34 devstack sudo[103578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d
Jun 15 04:27:34 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:34 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6" returned: 0 in 0.945s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:34 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d" returned: 0 in 0.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:34 devstack sudo[103591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6
Jun 15 04:27:34 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91aca4d7-2c5d-4567-9700-e67d7d3ae932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee704df-583b-48e8-8150-c5c7ef84483d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19c8d4c-9e4d-484b-92f6-088f2db4413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:34 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Volume volume-5ee704df-583b-48e8-8150-c5c7ef84483d (5ee704df-583b-48e8-8150-c5c7ef84483d): created successfully
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19c8d4c-9e4d-484b-92f6-088f2db4413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Flow 'volume_create_manager' (e54646b5-7919-42e9-a2ab-5e0a75f21b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:34 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-24825352-52e5-4716-ba24-b9aaa41e4553 tempest-AttachVolumeNegativeTest-393846504 None] Created volume successfully.
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[919efc60-55f8-4e9a-b9e9-c41c01e59ee6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:35 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69
Jun 15 04:27:35 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:35 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6" returned: 0 in 0.703s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:35 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:35 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Lock "cinder-quobyte-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6" released by "delete_volume" :: held 1.713s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Created reservations ['3a5165f4-dede-48f5-af48-3e5c6f5135a3', '55a0db73-e134-4304-9d8a-e621e13d8a72', '4e9b71ed-3d3e-4767-a157-acaaa62cb673', 'fca2265b-d28d-464a-810b-bdd8e72a04f9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:35 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:35 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:35 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" returned: 0 in 0.862s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.880s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ce0234c-3d3e-4073-b2b4-c5912af055ec', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:27:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-78acded6-cfce-495f-aead-26db7b39c255 req-a221f0cc-63b6-4ab0-9841-d47204a8bdb2 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] attachment_update completed successfully.
Jun 15 04:27:36 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.730s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:27:36 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.924s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Deleted volume successfully.
Jun 15 04:27:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0a8e40c1-0ce5-433a-9b6a-6f3e6eb4146b tempest-AbsoluteLimitsTests-2115146295 None] Lock "cinder-79e45c2c-20bb-4ff3-b0d1-bba9e17d21f6-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a844e-b23e-409b-b7c3-1ca918828518]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:39 devstack sudo[103997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d
Jun 15 04:27:39 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:40 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d" returned: 0 in 0.914s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-5ee704df-583b-48e8-8150-c5c7ef84483d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe01e6cf-66d9-4e87-b108-50cfe45ec856', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:27:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-c0c7bb25-0236-44d9-b407-05302b4210fe req-05d152e3-0d7d-4b17-808b-c4283f3e1142 tempest-AttachVolumeNegativeTest-393846504 None] attachment_update completed successfully.
Jun 15 04:27:40 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Flow 'volume_create_manager' (6fd49983-e2fd-4740-ada4-0f44056850c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759c4eb9-61e9-43cc-a5e7-9f8a2e423a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759c4eb9-61e9-43cc-a5e7-9f8a2e423a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1503193044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f166589-5a45-4cab-988e-7727ed389e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac3ec844024479d9716fa9de951548a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:41Z,use_quota=True,user_id='93eb5a62faa240ea979e5f4ca0be9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd87b7b7-0a69-4e50-8c57-ad67bb925ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd87b7b7-0a69-4e50-8c57-ad67bb925ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a74d2b0-a5eb-4214-9557-b0fb64b3c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a74d2b0-a5eb-4214-9557-b0fb64b3c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f166589-5a45-4cab-988e-7727ed389e21', 'volume_name': 'volume-6f166589-5a45-4cab-988e-7727ed389e21', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b6871f-e638-4968-98b9-5bed5817d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b6871f-e638-4968-98b9-5bed5817d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95051671-98d0-49a0-b7d9-33e2525bae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:41 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Volume 6f166589-5a45-4cab-988e-7727ed389e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f166589-5a45-4cab-988e-7727ed389e21', 'volume_size': 1}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1503193044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f166589-5a45-4cab-988e-7727ed389e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac3ec844024479d9716fa9de951548a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:41Z,use_quota=True,user_id='93eb5a62faa240ea979e5f4ca0be9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Creating volume 6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:41 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:41 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 1073741824
Jun 15 04:27:41 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:42 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 1073741824" returned: 0 in 0.966s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:42 devstack sudo[104046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21
Jun 15 04:27:42 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:42 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21" returned: 0 in 0.671s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95051671-98d0-49a0-b7d9-33e2525bae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f166589-5a45-4cab-988e-7727ed389e21', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b72c4c-953c-4fdc-8583-d513680c8e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:42 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Volume volume-6f166589-5a45-4cab-988e-7727ed389e21 (6f166589-5a45-4cab-988e-7727ed389e21): created successfully
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b72c4c-953c-4fdc-8583-d513680c8e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Flow 'volume_create_manager' (6fd49983-e2fd-4740-ada4-0f44056850c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d3a1b26a-392f-4cec-9927-46d6d69249c8 tempest-VolumesDeleteCascade-1601724153 None] Created volume successfully.
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Flow 'volume_create_manager' (37607bbe-4cbd-4552-92fb-27bb1ef8bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71b0eb1-0857-45fc-ab18-13318154a67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71b0eb1-0857-45fc-ab18-13318154a67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-337463378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d218bf9-fda9-4fc4-a486-cecb4a6393a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb33493790948fba6d63463ffbd695f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:43Z,use_quota=True,user_id='3581b29720c74b8291ccbdb97633f5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715520b-5dda-4cbb-9d37-9bfbabd433d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715520b-5dda-4cbb-9d37-9bfbabd433d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bee13f-77a9-4d37-8f29-ebc657f31662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Creating offline snapshot e60f11ed-51fc-4c6c-a886-08f61f8de59b of volume 6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5747e1f-c7b9-4cd6-bc0d-a207b2ead500]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bee13f-77a9-4d37-8f29-ebc657f31662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d218bf9-fda9-4fc4-a486-cecb4a6393a9', 'volume_name': 'volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c3862f90>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da83832c-a898-41d1-89ae-b37df1c09208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da83832c-a898-41d1-89ae-b37df1c09208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a46d9dd-bd19-4dfe-a274-0cb938dd1103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:43 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Volume 2d218bf9-fda9-4fc4-a486-cecb4a6393a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c3862f90>}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Trying to clone 2d218bf9-fda9-4fc4-a486-cecb4a6393a9 from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:27:43 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21
Jun 15 04:27:43 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:27:43 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[46accacc-9ce0-47bb-b7a0-ff5b605b3747]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:44 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD
Jun 15 04:27:44 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-6fd4f450-9c31-49b3-9a18-d0e4b5af350b req-afd1c3b3-f542-4728-b596-ae2cc5e62a86 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Terminate volume connection completed successfully.
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-6fd4f450-9c31-49b3-9a18-d0e4b5af350b req-afd1c3b3-f542-4728-b596-ae2cc5e62a86 tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Deleting attachment 5ce0234c-3d3e-4073-b2b4-c5912af055ec. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:27:44 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21" returned: 0 in 0.901s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:44 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b 1G
Jun 15 04:27:44 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:44 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde is fetched for user 3581b29720c74b8291ccbdb97633f5cb. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[04082375-a2fc-432c-8192-a102de1b8c7b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:44 devstack sudo[104064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD
Jun 15 04:27:44 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:45 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b 1G" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f166589-5a45-4cab-988e-7727ed389e21 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:45 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f166589-5a45-4cab-988e-7727ed389e21 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:27:45 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:45 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:45 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f166589-5a45-4cab-988e-7727ed389e21 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 0.734s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:45 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b is being set with open permissions: ugo+rw
Jun 15 04:27:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:45 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:27:45 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Acquiring lock "cinder-9ece12a1-5411-4aad-b1e9-a4d37cf46f69-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "cinder-9ece12a1-5411-4aad-b1e9-a4d37cf46f69-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Acquiring lock "cinder-quobyte-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "cinder-quobyte-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7164e9-6ac0-4694-9223-7a730fc9e472]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:46 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 0.697s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:46 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69
Jun 15 04:27:46 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:46 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info
Jun 15 04:27:46 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:47 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:47 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info" returned: 0 in 0.645s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:47 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info is being set with open permissions: ugo+rw
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" returned: 0 in 0.790s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:47 devstack sudo[104090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info
Jun 15 04:27:47 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:47 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69
Jun 15 04:27:47 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:47 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.info" returned: 0 in 0.638s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:47 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.555s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.416s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-337463378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d218bf9-fda9-4fc4-a486-cecb4a6393a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb33493790948fba6d63463ffbd695f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:27:43Z,use_quota=True,user_id='3581b29720c74b8291ccbdb97633f5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Creating volume 2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:27:47 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" returned: 0 in 0.682s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:47 devstack sudo[104096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 1073741824
Jun 15 04:27:47 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "cinder-quobyte-9ece12a1-5411-4aad-b1e9-a4d37cf46f69" released by "delete_volume" :: held 1.551s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:47 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ffeb364a-f4e9-495e-a7c1-0dc658977dc2 tempest-VolumesDeleteCascade-1601724153 None] Create snapshot completed successfully
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Created reservations ['304fad7c-48cd-478d-acfe-c3a371def7c6', 'fa2d31c2-4ed4-459d-a183-103421acd64e', '47349c77-b681-476c-9394-8a03b70930b1', '6ff70c5c-db19-4d0f-84b5-4e2af142792e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:48 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:27:48 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:27:48 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 1073741824" returned: 0 in 1.028s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:49 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.927s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:49 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:27:49 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Deleted volume successfully.
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1e9aef89-40fd-47bd-8a0f-9fff4f98887a tempest-TestServerVolumeAttachScenarioOldVersion-515361815 None] Lock "cinder-9ece12a1-5411-4aad-b1e9-a4d37cf46f69-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:49 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.750s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Creating offline snapshot 7a43d9c1-0f73-448d-842e-a8364d1a75a6 of volume 6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Attempting download of 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume 2d218bf9-fda9-4fc4-a486-cecb4a6393a9. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[090def78-d9ae-453e-b578-e7dc12ef9a68]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b665e8df-4195-49d8-a439-60177237d666]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:49 devstack sudo[104110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:27:49 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:49 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl
Jun 15 04:27:49 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:50 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 1.004s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f166589-5a45-4cab-988e-7727ed389e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:27:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:50 devstack sudo[104156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 1G
Jun 15 04:27:50 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:50 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl" returned: 0 in 1.010s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:50 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl
Jun 15 04:27:50 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:51 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl" returned: 1 in 0.710s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_w0udcfkl' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:27:51 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[04122b79-be9f-4bcc-92ee-4f54494238f6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:51 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 1G" returned: 0 in 0.890s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:51 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD
Jun 15 04:27:51 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:51 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6
Jun 15 04:27:51 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:52 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:52 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] 0ad3d500-cd6a-4357-9bcb-50810aab8cde was qcow2, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:27:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:52 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:27:52 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:52 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6" returned: 0 in 0.804s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:52 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 is being set with open permissions: ugo+rw
Jun 15 04:27:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:52 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6
Jun 15 04:27:52 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:53 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6" returned: 0 in 0.671s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.496s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:27:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5dc2622c-b2ca-4177-9d42-cd6ba223215b tempest-VolumesDeleteCascade-1601724153 None] Create snapshot completed successfully
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-6f166589-5a45-4cab-988e-7727ed389e21-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-6f166589-5a45-4cab-988e-7727ed389e21-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Performing cascade delete. {{(pid=92103) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-7a43d9c1-0f73-448d-842e-a8364d1a75a6-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-7a43d9c1-0f73-448d-842e-a8364d1a75a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-7a43d9c1-0f73-448d-842e-a8364d1a75a6" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-7a43d9c1-0f73-448d-842e-a8364d1a75a6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Deleting offline snapshot 7a43d9c1-0f73-448d-842e-a8364d1a75a6 of volume 6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] snapshot_file for this snap is: volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef565c9-1e33-445a-8abc-9ca86fa4ebd9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:54 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 2.194s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_1hxzqfkqdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:27:54 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Converted 112.00 MB image at 51.03 MB/s
Jun 15 04:27:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:54 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 1G
Jun 15 04:27:54 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:54 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6
Jun 15 04:27:54 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:55 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6" returned: 0 in 0.919s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f166589-5a45-4cab-988e-7727ed389e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4348a7e3-a49c-4174-9623-36e557307e64]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:55 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 1G" returned: 0 in 0.868s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[070f6f24-2309-4a81-866a-ffa3b7c00609]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:55 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:27:55 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:55 devstack sudo[104212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:27:55 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:56 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 0.905s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:56 devstack sudo[104242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:27:56 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:56 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 1.196s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f166589-5a45-4cab-988e-7727ed389e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:27:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:56 devstack sudo[104245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6
Jun 15 04:27:56 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:57 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 1 in 0.852s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Downloaded image 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume 2d218bf9-fda9-4fc4-a486-cecb4a6393a9 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde for user 3581b29720c74b8291ccbdb97633f5cb is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Marking volume 2d218bf9-fda9-4fc4-a486-cecb4a6393a9 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Copying metadata from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde to 2d218bf9-fda9-4fc4-a486-cecb4a6393a9. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Creating volume glance metadata for volume 2d218bf9-fda9-4fc4-a486-cecb4a6393a9 backed by image 0ad3d500-cd6a-4357-9bcb-50810aab8cde with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a46d9dd-bd19-4dfe-a274-0cb938dd1103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c3862f90>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d148b27-6886-4e2c-bbbf-83a3e1b5237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:27:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Volume volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 (2d218bf9-fda9-4fc4-a486-cecb4a6393a9): created successfully
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d148b27-6886-4e2c-bbbf-83a3e1b5237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Flow 'volume_create_manager' (37607bbe-4cbd-4552-92fb-27bb1ef8bc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:27:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5a7b1b0b-428f-4d0d-a207-d68cb292a044 tempest-TestShelveInstance-1513958534 None] Created volume successfully.
Jun 15 04:27:57 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6" returned: 0 in 0.968s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:57 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6
Jun 15 04:27:57 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:58 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.7a43d9c1-0f73-448d-842e-a8364d1a75a6" returned: 0 in 0.643s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-7a43d9c1-0f73-448d-842e-a8364d1a75a6" released by "_delete_snapshot" :: held 3.854s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" released by "delete_snapshot" :: held 3.896s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Created reservations ['b4aacb4b-a54b-4e06-ab7f-6c98d9ac0c9c', '4c06e61e-d0c9-4846-ba7e-42ecc02b2240', 'b49089b9-914d-4ed4-a42b-ebb096b3a5e9', 'fbd3229a-3676-43e8-8e82-aa3da1edab3a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:27:58 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Delete snapshot completed successfully.
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-7a43d9c1-0f73-448d-842e-a8364d1a75a6-delete_snapshot" released by "delete_snapshot" :: held 4.116s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-e60f11ed-51fc-4c6c-a886-08f61f8de59b-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-e60f11ed-51fc-4c6c-a886-08f61f8de59b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-e60f11ed-51fc-4c6c-a886-08f61f8de59b" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-e60f11ed-51fc-4c6c-a886-08f61f8de59b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Deleting offline snapshot e60f11ed-51fc-4c6c-a886-08f61f8de59b of volume 6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] snapshot_file for this snap is: volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79fb4d-9a2b-4e69-81a0-c0e95fa17361]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:58 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:27:58 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:27:59 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Jun 15 04:27:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 0.918s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:27:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f166589-5a45-4cab-988e-7727ed389e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:27:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16330a5-8ac5-4d15-9893-936fe6098763]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:27:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:27:59 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21
Jun 15 04:27:59 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:00 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21" returned: 0 in 0.945s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:00 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:28:00 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:01 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 1.135s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:01 devstack sudo[104343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b
Jun 15 04:28:01 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:02 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21.e60f11ed-51fc-4c6c-a886-08f61f8de59b" returned: 0 in 0.836s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-e60f11ed-51fc-4c6c-a886-08f61f8de59b" released by "_delete_snapshot" :: held 3.994s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" released by "delete_snapshot" :: held 4.030s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Created reservations ['1fb73f60-90ba-410e-afd0-147723db95a2', '3d5e6cae-888f-43c7-a6b1-203b183d641f', '0fe7092d-08bd-4eab-abfb-d7372d4b7e65', 'aed89ec3-2878-48d5-8cb4-1e157c06ccf7'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:28:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Delete snapshot completed successfully.
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-e60f11ed-51fc-4c6c-a886-08f61f8de59b-delete_snapshot" released by "delete_snapshot" :: held 4.235s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Snapshots deleted, issuing volume delete {{(pid=92103) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1557da1-eaf5-4989-a04a-134c102cc595]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:02 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21
Jun 15 04:28:02 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:03 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21" returned: 0 in 1.040s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:03 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21
Jun 15 04:28:03 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:04 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f166589-5a45-4cab-988e-7727ed389e21" returned: 0 in 0.935s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-6f166589-5a45-4cab-988e-7727ed389e21" released by "delete_volume" :: held 2.091s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:04 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Created reservations ['ff6cb36b-ab1e-4920-ba9e-4b2589cf8008', '5d42bfac-b007-4c95-aea3-3ad0fd03024c', 'ae1f81e1-fb7d-4299-9c0e-7deecac5cb9e', 'd288e79c-a627-47b6-a8e7-6ac438cab6c2'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:28:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:05 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:28:05 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff55e3-7e1b-4729-8adc-6c0ace5a2f47]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:06 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:28:06 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:06 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:28:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Deleted volume successfully.
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-84c2737d-f3a1-4404-b5ae-d221b06357b6 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-6f166589-5a45-4cab-988e-7727ed389e21-delete_volume" released by "delete_volume" :: held 12.634s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Flow 'volume_create_manager' (2e6e6801-3c94-41c7-a38f-14ce0fb1b28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d125ed93-f0ca-4800-a201-a3b886a8fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d125ed93-f0ca-4800-a201-a3b886a8fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1581909231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72291899-e8c2-474c-a3d4-454dd44e8fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac3ec844024479d9716fa9de951548a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:07Z,use_quota=True,user_id='93eb5a62faa240ea979e5f4ca0be9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4732f968-8109-4a67-8a2a-4e091c9794f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4732f968-8109-4a67-8a2a-4e091c9794f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774e7c1c-7055-427f-ab88-f6a1f39f6093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774e7c1c-7055-427f-ab88-f6a1f39f6093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72291899-e8c2-474c-a3d4-454dd44e8fda', 'volume_name': 'volume-72291899-e8c2-474c-a3d4-454dd44e8fda', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79388126-7db4-4c48-94f3-f0c82ce55dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79388126-7db4-4c48-94f3-f0c82ce55dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31b7cdb-c6c5-47f1-ab8e-5ed18cfc399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:07 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Volume 72291899-e8c2-474c-a3d4-454dd44e8fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72291899-e8c2-474c-a3d4-454dd44e8fda', 'volume_size': 1}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:07 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 1.270s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:07 devstack sudo[104374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:28:07 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:08 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 1 in 1.218s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.581s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.947s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1581909231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72291899-e8c2-474c-a3d4-454dd44e8fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac3ec844024479d9716fa9de951548a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:07Z,use_quota=True,user_id='93eb5a62faa240ea979e5f4ca0be9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Creating volume 72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:28:09 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:28:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:09 devstack sudo[104380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda 1073741824
Jun 15 04:28:09 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8587280-051d-4752-8cb2-139617934894', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:28:09 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-c9cd0f21-22c8-4abf-b8ef-f0213b4fc223 req-53bf6ee1-d3f8-4546-87f6-0b08bfd32191 tempest-TestShelveInstance-1513958534 None] attachment_update completed successfully.
Jun 15 04:28:10 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda 1073741824" returned: 0 in 1.251s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:10 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:10 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:11 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 0.951s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31b7cdb-c6c5-47f1-ab8e-5ed18cfc399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72291899-e8c2-474c-a3d4-454dd44e8fda', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa794d2-38be-4370-a9cc-f2ec55ae8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:11 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Volume volume-72291899-e8c2-474c-a3d4-454dd44e8fda (72291899-e8c2-474c-a3d4-454dd44e8fda): created successfully
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa794d2-38be-4370-a9cc-f2ec55ae8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Flow 'volume_create_manager' (2e6e6801-3c94-41c7-a38f-14ce0fb1b28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:11 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a05b7e0a-c1e4-471f-92ea-7a31d7a5653b tempest-VolumesDeleteCascade-1601724153 None] Created volume successfully.
Jun 15 04:28:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Creating offline snapshot 4d21ee41-89a4-4b84-b40b-cb38c561a7d2 of volume 72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:28:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c2c67a-ab30-4a58-a16a-2143ffeb7600]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:13 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:13 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:13 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 1.010s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:13 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 1G
Jun 15 04:28:13 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:14 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 1G" returned: 0 in 0.916s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72291899-e8c2-474c-a3d4-454dd44e8fda -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:14 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72291899-e8c2-474c-a3d4-454dd44e8fda -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2
Jun 15 04:28:14 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:15 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72291899-e8c2-474c-a3d4-454dd44e8fda -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2" returned: 0 in 1.050s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:15 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 is being set with open permissions: ugo+rw
Jun 15 04:28:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:15 devstack sudo[104495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2
Jun 15 04:28:15 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:16 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2" returned: 0 in 0.637s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:16 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info
Jun 15 04:28:16 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:17 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info" returned: 0 in 0.946s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:17 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info is being set with open permissions: ugo+rw
Jun 15 04:28:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:17 devstack sudo[104505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info
Jun 15 04:28:17 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:18 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.info" returned: 0 in 0.835s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.569s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:18 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0cb16cd7-06bc-4776-94eb-95c63273805c tempest-VolumesDeleteCascade-1601724153 None] Create snapshot completed successfully
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Flow 'volume_create_manager' (acd7f67e-923f-4c10-be19-9072dd0f8e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29169dee-eb03-4df1-a352-b332635ac640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29169dee-eb03-4df1-a352-b332635ac640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-635365172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac3ec844024479d9716fa9de951548a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4d21ee41-89a4-4b84-b40b-cb38c561a7d2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:20Z,use_quota=True,user_id='93eb5a62faa240ea979e5f4ca0be9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38f0dbb-8f45-4b5a-aa87-7fccc8d593df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38f0dbb-8f45-4b5a-aa87-7fccc8d593df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942248b-313f-498c-ad63-a70d223f3f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942248b-313f-498c-ad63-a70d223f3f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e', 'volume_name': 'volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e', 'volume_size': 1, 'snapshot_id': '4d21ee41-89a4-4b84-b40b-cb38c561a7d2'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf7f84-9cc0-4110-99df-9f693596078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65cf7f84-9cc0-4110-99df-9f693596078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a359e71a-24d2-47ec-8aec-5da7af62e391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:20 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Volume 15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e', 'volume_size': 1, 'snapshot_id': '4d21ee41-89a4-4b84-b40b-cb38c561a7d2'}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-4d21ee41-89a4-4b84-b40b-cb38c561a7d2-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-4d21ee41-89a4-4b84-b40b-cb38c561a7d2-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Creating volume 15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e from snapshot 4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] snapshot: 4d21ee41-89a4-4b84-b40b-cb38c561a7d2, volume: 15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b76f56-8164-4733-b478-924a87b246e9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:20 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2
Jun 15 04:28:20 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:21 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2" returned: 0 in 1.090s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72291899-e8c2-474c-a3d4-454dd44e8fda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:28:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:28:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:28:21 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e14d9-723b-434b-be72-38494ad18273]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:21 devstack sudo[104516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:21 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:22 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 1.202s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:22 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:28:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:22 devstack sudo[104522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e
Jun 15 04:28:22 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:30 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=67,cinder:SELECT=74,cinder:INSERT=21,cinder:DELETE=5 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:28:30 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=75,cinder:UPDATE=61,cinder:DELETE=7,cinder:INSERT=20 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:28:31 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" returned: 0 in 8.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:31 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e454d-9fa1-4daf-b152-8d074615b3f9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:31 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:31 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:32 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 1.635s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:28:33 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Converted 1024.00 MB image at 117.57 MB/s
Jun 15 04:28:33 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e is being set with open permissions: ugo+rw
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:33 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e
Jun 15 04:28:33 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:33 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" returned: 0 in 0.827s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" released by "_copy_volume_from_snapshot" :: held 13.642s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-4d21ee41-89a4-4b84-b40b-cb38c561a7d2-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" released by "_create_volume_from_snapshot" :: held 13.686s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.711s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a359e71a-24d2-47ec-8aec-5da7af62e391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e', 'volume_size': 1, 'snapshot_id': '4d21ee41-89a4-4b84-b40b-cb38c561a7d2'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6e2383-c414-476b-b6e6-ee9600b5d4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:33 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Volume volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e (15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e): created successfully
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6e2383-c414-476b-b6e6-ee9600b5d4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Flow 'volume_create_manager' (acd7f67e-923f-4c10-be19-9072dd0f8e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:33 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6bf6c9bc-c233-4457-89f2-4a527d0b8c79 tempest-VolumesDeleteCascade-1601724153 None] Created volume successfully.
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-72291899-e8c2-474c-a3d4-454dd44e8fda-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-72291899-e8c2-474c-a3d4-454dd44e8fda-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Performing cascade delete. {{(pid=92103) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-4d21ee41-89a4-4b84-b40b-cb38c561a7d2-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-4d21ee41-89a4-4b84-b40b-cb38c561a7d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-72291899-e8c2-474c-a3d4-454dd44e8fda" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-72291899-e8c2-474c-a3d4-454dd44e8fda" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-4d21ee41-89a4-4b84-b40b-cb38c561a7d2" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-4d21ee41-89a4-4b84-b40b-cb38c561a7d2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Deleting offline snapshot 4d21ee41-89a4-4b84-b40b-cb38c561a7d2 of volume 72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] snapshot_file for this snap is: volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[871cd83f-96ba-4733-80ca-57bb03a84120]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:35 devstack sudo[104678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:28:35 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:35 devstack sudo[104677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2
Jun 15 04:28:35 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:36 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.813s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:28:36 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2" returned: 0 in 0.914s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72291899-e8c2-474c-a3d4-454dd44e8fda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bea136-12cd-4daf-80ea-f3b0d6a3e282]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:36 devstack sudo[104687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:36 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:37 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 0.790s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:37 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2
Jun 15 04:28:37 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:37 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2" returned: 0 in 0.774s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:38 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2
Jun 15 04:28:38 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:38 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda.4d21ee41-89a4-4b84-b40b-cb38c561a7d2" returned: 0 in 0.680s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-4d21ee41-89a4-4b84-b40b-cb38c561a7d2" released by "_delete_snapshot" :: held 3.273s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-72291899-e8c2-474c-a3d4-454dd44e8fda" released by "delete_snapshot" :: held 3.300s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Created reservations ['a99a1664-d92e-43e3-bacb-612a95cea7ec', '4056d39d-5d25-494c-a706-24137287de97', '5ed86860-9f24-4ba7-9393-1b7e8844d68a', 'f9cdf007-cb90-4bef-9b7f-78a6f37a5de3'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:28:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Delete snapshot completed successfully.
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-4d21ee41-89a4-4b84-b40b-cb38c561a7d2-delete_snapshot" released by "delete_snapshot" :: held 3.513s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Snapshots deleted, issuing volume delete {{(pid=92103) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-72291899-e8c2-474c-a3d4-454dd44e8fda" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-72291899-e8c2-474c-a3d4-454dd44e8fda" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce105f3-ffbd-46fe-84b1-42945750faf8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:39 devstack sudo[104701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:39 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:39 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 0.871s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:39 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda
Jun 15 04:28:39 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:40 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-72291899-e8c2-474c-a3d4-454dd44e8fda" returned: 0 in 0.716s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-72291899-e8c2-474c-a3d4-454dd44e8fda" released by "delete_volume" :: held 1.690s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Created reservations ['7d18049f-985c-4d78-b5ba-8b353e9a90d2', '8601ffc0-53c1-4438-8b41-1414b6f53c35', 'c84b0d01-8c0c-41af-94a0-a27b9c14f353', 'bb163a79-de21-48cd-94a8-764cae61bf1d'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:40 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:28:40 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:41 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.849s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:41 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:28:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Deleted volume successfully.
Jun 15 04:28:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-865d2941-a756-4de9-b774-65fc0a35be83 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-72291899-e8c2-474c-a3d4-454dd44e8fda-delete_volume" released by "delete_volume" :: held 6.554s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "cinder-quobyte-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d9e29-2346-4ed6-a6e1-f6c3348c7d23]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:42 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e
Jun 15 04:28:42 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-13074e55-b7aa-48aa-a664-1ac33a149a44 req-fee4e978-d55f-400b-9d33-d73cfbafa97f tempest-AttachVolumeNegativeTest-393846504 None] Terminate volume connection completed successfully.
Jun 15 04:28:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-13074e55-b7aa-48aa-a664-1ac33a149a44 req-fee4e978-d55f-400b-9d33-d73cfbafa97f tempest-AttachVolumeNegativeTest-393846504 None] Deleting attachment fe01e6cf-66d9-4e87-b108-50cfe45ec856. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:28:43 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" returned: 0 in 0.945s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:43 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e
Jun 15 04:28:43 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Flow 'volume_create_manager' (2d1b1f4a-2618-444f-8788-3f46d3fbad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07658d9f-6411-4f16-8c81-83a16cf327c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07658d9f-6411-4f16-8c81-83a16cf327c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1800155120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01ebb47-8aed-4407-95b3-8eed8f44b257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5375e9ae9cd64606b6dc7df53b5f3e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:44Z,use_quota=True,user_id='325428abde4c4eec9237fccf5fd9236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb237f6b-f7b7-4a34-868c-10e5d04bd3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb237f6b-f7b7-4a34-868c-10e5d04bd3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d271b33-0f45-42e6-9429-5352d8a2ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d271b33-0f45-42e6-9429-5352d8a2ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01ebb47-8aed-4407-95b3-8eed8f44b257', 'volume_name': 'volume-d01ebb47-8aed-4407-95b3-8eed8f44b257', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81703eff-f652-42fa-b2e4-f82fa8eaf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81703eff-f652-42fa-b2e4-f82fa8eaf304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aea838c-bb5a-44ee-ab5d-0c51f2f96863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:43 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Volume d01ebb47-8aed-4407-95b3-8eed8f44b257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01ebb47-8aed-4407-95b3-8eed8f44b257', 'volume_size': 1}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1800155120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01ebb47-8aed-4407-95b3-8eed8f44b257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5375e9ae9cd64606b6dc7df53b5f3e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:44Z,use_quota=True,user_id='325428abde4c4eec9237fccf5fd9236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Creating volume d01ebb47-8aed-4407-95b3-8eed8f44b257 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:28:43 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:43 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 1073741824
Jun 15 04:28:43 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:43 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:28:44 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Flow 'volume_create_manager' (ba170c1e-1e67-4d23-b5ef-8f100945857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bb0fdb-601b-490e-a2de-8e3ae3a05886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" returned: 0 in 0.758s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bb0fdb-601b-490e-a2de-8e3ae3a05886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1906934566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e11f89-9f1d-46cc-80ee-9eda9907828d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5375e9ae9cd64606b6dc7df53b5f3e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:44Z,use_quota=True,user_id='325428abde4c4eec9237fccf5fd9236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d768076d-7551-48e3-bd5b-4b5c705c5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d768076d-7551-48e3-bd5b-4b5c705c5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64af1a67-e5ed-49e6-9960-d582f172aa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64af1a67-e5ed-49e6-9960-d582f172aa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e11f89-9f1d-46cc-80ee-9eda9907828d', 'volume_name': 'volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d33694f-127a-4f50-b68f-498d4b0000b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d33694f-127a-4f50-b68f-498d4b0000b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3cad2b-674d-459f-8760-543e2cde46d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:44 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Volume c1e11f89-9f1d-46cc-80ee-9eda9907828d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d', 'volume_size': 1}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-quobyte-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e" released by "delete_volume" :: held 1.831s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Created reservations ['7d6ea2cd-a261-49ae-a83d-786bdfe5c2b6', 'd219d23f-f3af-4690-bac4-6c2f78ed2fc4', '925c18bf-a611-449d-9380-b17965b0c5ce', 'aa94e99c-057e-4444-88e8-c8d79278affe'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:44 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:28:44 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:45 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 1073741824" returned: 0 in 1.538s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:45 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257
Jun 15 04:28:45 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:45 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.149s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:45 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:28:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Deleted volume successfully.
Jun 15 04:28:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-05b4ee27-2a35-4687-ac41-8e4f3b5cd1a3 tempest-VolumesDeleteCascade-1601724153 None] Lock "cinder-15fdfa29-caaa-4893-b1a7-52a0dfdcfc0e-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:46 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257" returned: 0 in 0.821s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.427s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1906934566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e11f89-9f1d-46cc-80ee-9eda9907828d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5375e9ae9cd64606b6dc7df53b5f3e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:44Z,use_quota=True,user_id='325428abde4c4eec9237fccf5fd9236b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Creating volume c1e11f89-9f1d-46cc-80ee-9eda9907828d {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:28:46 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aea838c-bb5a-44ee-ab5d-0c51f2f96863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01ebb47-8aed-4407-95b3-8eed8f44b257', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:46 devstack sudo[104814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d 1073741824
Jun 15 04:28:46 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d2c6c4-006e-4ac7-801a-27cd23306d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:46 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Volume volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 (d01ebb47-8aed-4407-95b3-8eed8f44b257): created successfully
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d2c6c4-006e-4ac7-801a-27cd23306d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Flow 'volume_create_manager' (2d1b1f4a-2618-444f-8788-3f46d3fbad47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5579d0f8-06a2-44b4-8c0d-a02276d7ceb0 tempest-TestServerVolumeAttachmentScenario-137337885 None] Created volume successfully.
Jun 15 04:28:47 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d 1073741824" returned: 0 in 1.221s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:47 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d
Jun 15 04:28:47 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:48 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d" returned: 0 in 0.710s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3cad2b-674d-459f-8760-543e2cde46d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bc5b3e-bccd-42e7-bae1-2576dccb8065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:48 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Volume volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d (c1e11f89-9f1d-46cc-80ee-9eda9907828d): created successfully
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bc5b3e-bccd-42e7-bae1-2576dccb8065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Flow 'volume_create_manager' (ba170c1e-1e67-4d23-b5ef-8f100945857b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-413b00d8-ae84-4f98-b622-31cd3ab725a8 tempest-TestServerVolumeAttachmentScenario-137337885 None] Created volume successfully.
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Flow 'volume_create_manager' (49064562-1373-45fc-b90a-87d906bdcfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5fa030-e2a7-45df-8527-ba9d4b3283cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5fa030-e2a7-45df-8527-ba9d4b3283cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-617348987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c471b8-b88c-4efa-8f09-94673512f7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d670cc37d3c245d788d961ab95d5ccd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:51Z,use_quota=True,user_id='088e787a2b2b4d86be5b0b6de82e4782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc076cc-0b9a-4206-9357-9122fe2685fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc076cc-0b9a-4206-9357-9122fe2685fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4e8e52-ba39-415a-b404-a373fcdf785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4e8e52-ba39-415a-b404-a373fcdf785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c471b8-b88c-4efa-8f09-94673512f7dc', 'volume_name': 'volume-47c471b8-b88c-4efa-8f09-94673512f7dc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c81f27-0e55-469f-9335-539e224e51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c81f27-0e55-469f-9335-539e224e51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf224832-927b-406a-b168-aee4efe9e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:51 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Volume 47c471b8-b88c-4efa-8f09-94673512f7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c471b8-b88c-4efa-8f09-94673512f7dc', 'volume_size': 1}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-617348987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c471b8-b88c-4efa-8f09-94673512f7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d670cc37d3c245d788d961ab95d5ccd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:51Z,use_quota=True,user_id='088e787a2b2b4d86be5b0b6de82e4782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Creating volume 47c471b8-b88c-4efa-8f09-94673512f7dc {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:28:51 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-4c5adcd5-1423-4881-be26-dc0c61bef425 req-b61b34a7-ee29-4d6c-8d77-6bb788f1fe7c tempest-TestShelveInstance-1513958534 None] Terminate volume connection completed successfully.
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-4c5adcd5-1423-4881-be26-dc0c61bef425 req-b61b34a7-ee29-4d6c-8d77-6bb788f1fe7c tempest-TestShelveInstance-1513958534 None] Deleting attachment f8587280-051d-4752-8cb2-139617934894. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:28:51 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc 1073741824
Jun 15 04:28:51 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:51 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc 1073741824" returned: 0 in 0.866s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:52 devstack sudo[104891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc
Jun 15 04:28:52 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:52 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc" returned: 0 in 0.593s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf224832-927b-406a-b168-aee4efe9e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c471b8-b88c-4efa-8f09-94673512f7dc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94b27f6-9aeb-42d3-a5b1-e67f0870d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:52 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Volume volume-47c471b8-b88c-4efa-8f09-94673512f7dc (47c471b8-b88c-4efa-8f09-94673512f7dc): created successfully
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94b27f6-9aeb-42d3-a5b1-e67f0870d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Flow 'volume_create_manager' (49064562-1373-45fc-b90a-87d906bdcfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b4123d07-84ad-4996-95e7-55b90118ef05 tempest-VolumesTransfersV357Test-1489330913 None] Created volume successfully.
Jun 15 04:28:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-04b0846b-006c-48ee-b2a6-600aea3f621c tempest-VolumesTransfersV357Test-1082999890 None] Transfer volume completed successfully.
Jun 15 04:28:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Acquiring lock "cinder-47c471b8-b88c-4efa-8f09-94673512f7dc-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-47c471b8-b88c-4efa-8f09-94673512f7dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Acquiring lock "cinder-quobyte-47c471b8-b88c-4efa-8f09-94673512f7dc" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:28:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-quobyte-47c471b8-b88c-4efa-8f09-94673512f7dc" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:28:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f36b89-28e0-4e2c-bca9-8940dd827e89]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:55 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc
Jun 15 04:28:55 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:56 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc" returned: 0 in 1.012s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:56 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc
Jun 15 04:28:56 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:57 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-47c471b8-b88c-4efa-8f09-94673512f7dc" returned: 0 in 0.976s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-quobyte-47c471b8-b88c-4efa-8f09-94673512f7dc" released by "delete_volume" :: held 2.058s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Created reservations ['31fce138-00a6-4085-9c82-cfe431c736e3', 'a840ce03-2ead-4425-b64b-178da8872187', '1b8768c0-b16a-4ac9-bf56-dafbe13f228c', '320c4225-b7e2-4a76-a617-5a314d3f23d6'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:57 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:28:57 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4912b3-41af-4410-b3a3-a4abea86c05c]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:28:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:57 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:28:57 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:58 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.638s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:58 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:28:58 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Deleted volume successfully.
Jun 15 04:28:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1a42f268-03ba-48e3-bb2f-fcb07e773cb5 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-47c471b8-b88c-4efa-8f09-94673512f7dc-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:28:58 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 0.785s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:58 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:28:58 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Flow 'volume_create_manager' (61811643-295f-46b9-90d8-f179b55eb52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531ffaa5-f736-4007-b4ca-881452a9abd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531ffaa5-f736-4007-b4ca-881452a9abd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-84751301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d670cc37d3c245d788d961ab95d5ccd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:59Z,use_quota=True,user_id='088e787a2b2b4d86be5b0b6de82e4782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1998851c-0420-4bd9-98aa-bf21afd7172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1998851c-0420-4bd9-98aa-bf21afd7172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d495bcfc-8b97-4351-8a29-e3476dd97a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d495bcfc-8b97-4351-8a29-e3476dd97a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df', 'volume_name': 'volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8b4060-1f48-4845-bfe9-468a87df07de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8b4060-1f48-4845-bfe9-468a87df07de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb04dd82-5a9d-4c2c-8f7d-01a4917ae6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:28:59 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Volume 6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df', 'volume_size': 1}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:59 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 1 in 0.948s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.844s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-84751301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d670cc37d3c245d788d961ab95d5ccd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:28:59Z,use_quota=True,user_id='088e787a2b2b4d86be5b0b6de82e4782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Creating volume 6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:28:59 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:28:59 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df 1073741824
Jun 15 04:28:59 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:28:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f334003-69ff-4f05-aa60-f2bba6bdc300', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:28:59 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-96e6d0b0-6427-4cf0-b579-a93d4bfc565c req-7993fdc3-0af8-40ec-9301-13764b52e0aa tempest-TestShelveInstance-1513958534 None] attachment_update completed successfully.
Jun 15 04:29:00 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df 1073741824" returned: 0 in 0.915s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:00 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df
Jun 15 04:29:00 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:00 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df" returned: 0 in 0.587s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb04dd82-5a9d-4c2c-8f7d-01a4917ae6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c43dc09-9d8a-4ef1-af82-caa90523d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Volume volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df (6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df): created successfully
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c43dc09-9d8a-4ef1-af82-caa90523d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Flow 'volume_create_manager' (61811643-295f-46b9-90d8-f179b55eb52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-30034349-e5cd-4758-a3d9-26d55d7c977d tempest-VolumesTransfersV357Test-1489330913 None] Created volume successfully.
Jun 15 04:29:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Acquiring lock "cinder-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Acquiring lock "cinder-quobyte-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-quobyte-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df" acquired by "delete_volume" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:01 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d90abcf-b3c5-41d5-9d80-bfc461463587]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:01 devstack sudo[104957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df
Jun 15 04:29:01 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:02 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df" returned: 0 in 0.710s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:02 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df
Jun 15 04:29:02 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:03 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df" returned: 0 in 1.125s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-quobyte-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df" released by "delete_volume" :: held 1.887s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Created reservations ['9f741f97-41be-4633-a780-e97e7f0a00c4', '6aae8a3a-0595-4ed7-9efa-4b4f8b345fb0', 'd04f103b-7231-43cc-a0d8-776f1c487d4d', '03a16ff6-6e39-478a-9463-8f316f266e51'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:03 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:29:03 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:04 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.359s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:04 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:29:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Deleted volume successfully.
Jun 15 04:29:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-698fb493-0e64-4bae-804e-4ece5d09dcf4 tempest-VolumesTransfersV357Test-510325445 None] Lock "cinder-6f0375ec-fd2b-4cf9-9dc8-d7cee60af3df-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:13 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=39,cinder:UPDATE=52,cinder:INSERT=16,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:29:15 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=53,cinder:DELETE=8,cinder:SELECT=45,cinder:INSERT=8 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Flow 'volume_create_manager' (a22fbab2-87dd-48d6-bd99-e3d9b3e2b850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9401c52e-7648-4ab8-bf2d-eff17546dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9401c52e-7648-4ab8-bf2d-eff17546dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-56651721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d936f22e-6317-44d8-a3f8-683cd26d545f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee42a0a6607d4cffa3ab66194883af75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:18Z,use_quota=True,user_id='fdf2e7932cfa47d0976b3e4283e57471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce9605c-4405-473c-a2fd-0e1e1dbf8a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce9605c-4405-473c-a2fd-0e1e1dbf8a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d811bf-1d47-46fe-8db4-56043cd8d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d811bf-1d47-46fe-8db4-56043cd8d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd936f22e-6317-44d8-a3f8-683cd26d545f', 'volume_name': 'volume-d936f22e-6317-44d8-a3f8-683cd26d545f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc441e18-d304-4469-8162-a68575b21490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc441e18-d304-4469-8162-a68575b21490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472918f3-119e-45a1-bc05-84c8d6568aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Volume d936f22e-6317-44d8-a3f8-683cd26d545f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d936f22e-6317-44d8-a3f8-683cd26d545f', 'volume_size': 1}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-56651721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d936f22e-6317-44d8-a3f8-683cd26d545f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee42a0a6607d4cffa3ab66194883af75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:18Z,use_quota=True,user_id='fdf2e7932cfa47d0976b3e4283e57471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Creating volume d936f22e-6317-44d8-a3f8-683cd26d545f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:29:17 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:29:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:17 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f 1073741824
Jun 15 04:29:17 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:18 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f 1073741824" returned: 0 in 1.052s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:18 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f
Jun 15 04:29:18 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:19 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472918f3-119e-45a1-bc05-84c8d6568aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d936f22e-6317-44d8-a3f8-683cd26d545f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e888090a-17c1-402e-8e42-f197d13b35db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:19 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Volume volume-d936f22e-6317-44d8-a3f8-683cd26d545f (d936f22e-6317-44d8-a3f8-683cd26d545f): created successfully
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e888090a-17c1-402e-8e42-f197d13b35db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Flow 'volume_create_manager' (a22fbab2-87dd-48d6-bd99-e3d9b3e2b850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-eeab2813-bd93-4736-a348-bdb29e999c0f tempest-VolumesListTestJSON-2067047147 None] Created volume successfully.
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Flow 'volume_create_manager' (cd4bb47b-2dd9-4e84-8c39-f6c8a0de1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3770846d-2d5a-42f2-bc9d-809666872638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3770846d-2d5a-42f2-bc9d-809666872638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-73367651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec8b438-49f8-43b5-9ad0-6d544b4db089,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee42a0a6607d4cffa3ab66194883af75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:21Z,use_quota=True,user_id='fdf2e7932cfa47d0976b3e4283e57471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf85032c-ecd6-43f4-b545-2114045a83f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf85032c-ecd6-43f4-b545-2114045a83f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e509d25-57bc-40b9-8746-c1bf1c9c5530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e509d25-57bc-40b9-8746-c1bf1c9c5530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec8b438-49f8-43b5-9ad0-6d544b4db089', 'volume_name': 'volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3113f1-75be-405e-8ec2-6e05dcf36ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3113f1-75be-405e-8ec2-6e05dcf36ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98687604-a12f-4a41-9cc3-d2ca3242aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Volume 5ec8b438-49f8-43b5-9ad0-6d544b4db089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089', 'volume_size': 1}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-73367651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec8b438-49f8-43b5-9ad0-6d544b4db089,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee42a0a6607d4cffa3ab66194883af75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:21Z,use_quota=True,user_id='fdf2e7932cfa47d0976b3e4283e57471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Creating volume 5ec8b438-49f8-43b5-9ad0-6d544b4db089 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:29:21 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:29:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:21 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 1073741824
Jun 15 04:29:21 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:22 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 1073741824" returned: 0 in 0.828s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:22 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089
Jun 15 04:29:22 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:23 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089" returned: 0 in 0.627s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98687604-a12f-4a41-9cc3-d2ca3242aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fca7a7-2150-42b0-8bad-54a040c6f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:23 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Volume volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 (5ec8b438-49f8-43b5-9ad0-6d544b4db089): created successfully
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fca7a7-2150-42b0-8bad-54a040c6f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Flow 'volume_create_manager' (cd4bb47b-2dd9-4e84-8c39-f6c8a0de1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-dd5aed4c-48d7-43b7-8f3d-07595a831e8e tempest-VolumesListTestJSON-2067047147 None] Created volume successfully.
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Flow 'volume_create_manager' (2ed5baf8-361c-408c-853f-f278b42a78cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f13664b-df38-450d-840d-ad458ab3cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f13664b-df38-450d-840d-ad458ab3cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1118753092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f874a3-e368-4fa9-8042-95254d20fbd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee42a0a6607d4cffa3ab66194883af75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:24Z,use_quota=True,user_id='fdf2e7932cfa47d0976b3e4283e57471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dfcf2f-e9af-49e6-96cd-28fb562fdd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dfcf2f-e9af-49e6-96cd-28fb562fdd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85eadd3-b976-4203-a023-cf74b2e843c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85eadd3-b976-4203-a023-cf74b2e843c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f874a3-e368-4fa9-8042-95254d20fbd9', 'volume_name': 'volume-42f874a3-e368-4fa9-8042-95254d20fbd9', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8e583-53d0-4674-9210-ded3557808e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8e583-53d0-4674-9210-ded3557808e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc050ae-3c7a-4a6e-9a07-8d7969a94505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:24 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Volume 42f874a3-e368-4fa9-8042-95254d20fbd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f874a3-e368-4fa9-8042-95254d20fbd9', 'volume_size': 1}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1118753092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f874a3-e368-4fa9-8042-95254d20fbd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee42a0a6607d4cffa3ab66194883af75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:24Z,use_quota=True,user_id='fdf2e7932cfa47d0976b3e4283e57471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Creating volume 42f874a3-e368-4fa9-8042-95254d20fbd9 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:29:24 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:29:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:24 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9 1073741824
Jun 15 04:29:24 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:25 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9 1073741824" returned: 0 in 1.136s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:25 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9
Jun 15 04:29:25 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:26 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9" returned: 0 in 0.894s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc050ae-3c7a-4a6e-9a07-8d7969a94505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f874a3-e368-4fa9-8042-95254d20fbd9', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f4bafd-55e0-4f18-9d8f-152d1d5357c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:26 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Volume volume-42f874a3-e368-4fa9-8042-95254d20fbd9 (42f874a3-e368-4fa9-8042-95254d20fbd9): created successfully
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f4bafd-55e0-4f18-9d8f-152d1d5357c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Flow 'volume_create_manager' (2ed5baf8-361c-408c-853f-f278b42a78cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:26 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-59762a2d-aa4e-48f0-a117-607ec6043c3c tempest-VolumesListTestJSON-2067047147 None] Created volume successfully.
Jun 15 04:29:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "cinder-42f874a3-e368-4fa9-8042-95254d20fbd9-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-42f874a3-e368-4fa9-8042-95254d20fbd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "cinder-quobyte-42f874a3-e368-4fa9-8042-95254d20fbd9" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-quobyte-42f874a3-e368-4fa9-8042-95254d20fbd9" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:29 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1930a45c-96ad-436a-a0f9-944bac87f986]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:30 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9
Jun 15 04:29:30 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:30 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9" returned: 0 in 0.760s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:30 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9
Jun 15 04:29:30 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:31 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-42f874a3-e368-4fa9-8042-95254d20fbd9" returned: 0 in 0.608s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-quobyte-42f874a3-e368-4fa9-8042-95254d20fbd9" released by "delete_volume" :: held 1.413s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Created reservations ['cb2b00ab-a7ed-4544-a40f-573bb05d4728', 'fbb701e9-340c-428b-a16e-3ec79aa6ce40', 'bb7c3498-f90f-4e84-9c39-36c8ebde6fb4', '62f7287f-2d37-4a3a-ace2-2584c21caa41'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:31 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:29:31 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:32 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.647s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:29:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Deleted volume successfully.
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-636803e7-caa1-4a57-ab36-23aa62701c8a tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-42f874a3-e368-4fa9-8042-95254d20fbd9-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "cinder-5ec8b438-49f8-43b5-9ad0-6d544b4db089-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-5ec8b438-49f8-43b5-9ad0-6d544b4db089-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "cinder-quobyte-5ec8b438-49f8-43b5-9ad0-6d544b4db089" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-quobyte-5ec8b438-49f8-43b5-9ad0-6d544b4db089" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa96455b-8e88-47ca-b0c3-d172718b6ad6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:32 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089
Jun 15 04:29:32 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:33 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089" returned: 0 in 0.759s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:33 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089
Jun 15 04:29:33 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0782a5-0c1a-489e-a552-cc4bce56ae21]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:33 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257
Jun 15 04:29:33 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:33 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ec8b438-49f8-43b5-9ad0-6d544b4db089" returned: 0 in 0.615s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-quobyte-5ec8b438-49f8-43b5-9ad0-6d544b4db089" released by "delete_volume" :: held 1.418s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Created reservations ['833a1d44-c4f7-4fc9-bfab-9d57c65c5494', 'b25f49b7-392b-4ec4-9e7a-45f8f2cf09fe', '3df1063f-62e6-490e-8d7d-9b50a61704ab', '5f68006d-05c3-4bac-accb-9edc3256ca57'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:33 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:29:33 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:34 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257" returned: 0 in 0.733s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.753s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-d01ebb47-8aed-4407-95b3-8eed8f44b257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa3142b4-fc42-4f38-bbc0-7789a62db363', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:29:34 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-0486a8c2-d43c-4874-aef8-2536bd834e7b req-a2144c33-f79a-42db-81d6-d94f6d10eb17 tempest-TestServerVolumeAttachmentScenario-137337885 None] attachment_update completed successfully.
Jun 15 04:29:34 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.626s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:29:34 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Deleted volume successfully.
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-58f0b07c-6db6-4981-8bcf-0110885b4ee5 tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-5ec8b438-49f8-43b5-9ad0-6d544b4db089-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "cinder-d936f22e-6317-44d8-a3f8-683cd26d545f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-d936f22e-6317-44d8-a3f8-683cd26d545f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "cinder-quobyte-d936f22e-6317-44d8-a3f8-683cd26d545f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-quobyte-d936f22e-6317-44d8-a3f8-683cd26d545f" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84da851-5723-49c2-8fab-384237bedd77]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:34 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f
Jun 15 04:29:34 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:35 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:35 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f
Jun 15 04:29:35 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:35 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:29:35 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:35 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d936f22e-6317-44d8-a3f8-683cd26d545f" returned: 0 in 0.590s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-quobyte-d936f22e-6317-44d8-a3f8-683cd26d545f" released by "delete_volume" :: held 1.341s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Created reservations ['2132a3ab-5f32-4dbb-8a54-27a28eb8d2c3', 'ddee1b04-1afe-4b3c-b48b-63ea940c5dac', '80dcc64d-4014-420f-8c1c-02f48f9474e2', '97a468ff-fbee-446d-8cc4-1c37d896bf4a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:36 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:29:36 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:36 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.615s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:29:36 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.631s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:29:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Deleted volume successfully.
Jun 15 04:29:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8819a178-a483-47d3-8304-512b91f93bff tempest-VolumesListTestJSON-2067047147 None] Lock "cinder-d936f22e-6317-44d8-a3f8-683cd26d545f-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Flow 'volume_create_manager' (91850a7f-f00e-4718-9443-96e9d415d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23d3457-1386-47d9-ae11-5b7ad8805e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23d3457-1386-47d9-ae11-5b7ad8805e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1503721892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1972f04-b43e-49a3-94c0-5e0bd130f1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0029743a845647789425c17cf697f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:40Z,use_quota=True,user_id='e6110f5b1c6c4dfd8e51b202d53c7f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e2865a-8573-4482-9dce-fb89c1a5695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e2865a-8573-4482-9dce-fb89c1a5695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93f4168-d9c4-4d1b-b626-48cf617b0124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93f4168-d9c4-4d1b-b626-48cf617b0124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1972f04-b43e-49a3-94c0-5e0bd130f1f4', 'volume_name': 'volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef2870-6242-4020-91f5-bfb23aa86420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef2870-6242-4020-91f5-bfb23aa86420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3820c9-c6ad-4d41-b203-49c32b36a185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:40 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Volume b1972f04-b43e-49a3-94c0-5e0bd130f1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4', 'volume_size': 1}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1503721892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1972f04-b43e-49a3-94c0-5e0bd130f1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0029743a845647789425c17cf697f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:29:40Z,use_quota=True,user_id='e6110f5b1c6c4dfd8e51b202d53c7f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Creating volume b1972f04-b43e-49a3-94c0-5e0bd130f1f4 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:29:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:29:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:40 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 1073741824
Jun 15 04:29:40 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:41 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 1073741824" returned: 0 in 1.002s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:41 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4
Jun 15 04:29:41 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:41 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" returned: 0 in 0.646s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3820c9-c6ad-4d41-b203-49c32b36a185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e8d0ca-87ab-44e9-bac5-f50f787514ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:29:41 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Volume volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 (b1972f04-b43e-49a3-94c0-5e0bd130f1f4): created successfully
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e8d0ca-87ab-44e9-bac5-f50f787514ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:29:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Flow 'volume_create_manager' (91850a7f-f00e-4718-9443-96e9d415d76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:29:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9c7a23ad-14ba-47ca-b877-05da44266767 tempest-AttachVolumeNegativeTest-393846504 None] Created volume successfully.
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9bfc94-563a-415a-8fe9-d205473571ca]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:45 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d
Jun 15 04:29:45 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:29:45 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d" returned: 0 in 0.809s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.555s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[858819a8-e875-4fd8-92ab-e87caa6b2a9d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:29:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed8a567f-6f7f-4719-9663-7b996edf165c', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:29:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-711289fd-526b-47f9-9da8-128b2132b0d8 req-392787d1-2e1a-47b1-975a-52a0ea9a2950 tempest-TestServerVolumeAttachmentScenario-137337885 None] attachment_update completed successfully.
Jun 15 04:29:46 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4
Jun 15 04:29:46 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:29:46 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Jun 15 04:29:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" returned: 0 in 0.783s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:29:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:29:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9524572-20a3-4f8c-a2ca-5ff33c6921f8', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:29:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-6814749a-e1ae-46db-bc7d-633b05a040b1 req-3edcab47-ae8b-40c8-b7a9-482824ed5415 tempest-AttachVolumeNegativeTest-393846504 None] attachment_update completed successfully.
Jun 15 04:29:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-9b1b5115-c511-40e9-887b-4b7f76c0beb1 req-a3cfa52f-9cfc-44b2-abac-8eeff6534d94 tempest-TestServerVolumeAttachmentScenario-137337885 None] Terminate volume connection completed successfully.
Jun 15 04:29:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-9b1b5115-c511-40e9-887b-4b7f76c0beb1 req-a3cfa52f-9cfc-44b2-abac-8eeff6534d94 tempest-TestServerVolumeAttachmentScenario-137337885 None] Deleting attachment ed8a567f-6f7f-4719-9663-7b996edf165c. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:29:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-02bb4f01-2de1-46d5-89c0-9f4c811a60c1 req-f3b744c8-1d69-4352-8178-6e72e759449f tempest-AttachVolumeNegativeTest-393846504 None] Terminate volume connection completed successfully.
Jun 15 04:29:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-02bb4f01-2de1-46d5-89c0-9f4c811a60c1 req-f3b744c8-1d69-4352-8178-6e72e759449f tempest-AttachVolumeNegativeTest-393846504 None] Deleting attachment b9524572-20a3-4f8c-a2ca-5ff33c6921f8. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:29:56 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-437ab338-ce55-40a5-b8e7-dbf164dcef05 req-faf00eb4-817a-4366-9276-fa209dc5fba1 tempest-TestServerVolumeAttachmentScenario-137337885 None] Terminate volume connection completed successfully.
Jun 15 04:29:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-437ab338-ce55-40a5-b8e7-dbf164dcef05 req-faf00eb4-817a-4366-9276-fa209dc5fba1 tempest-TestServerVolumeAttachmentScenario-137337885 None] Deleting attachment aa3142b4-fc42-4f38-bbc0-7789a62db363. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:30:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-e6dcfaa5-e3ed-40cf-ba76-dc7a20dee975 tempest-TestShelveInstance-1513958534 None] Terminate volume connection completed successfully.
Jun 15 04:30:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-e6dcfaa5-e3ed-40cf-ba76-dc7a20dee975 tempest-TestShelveInstance-1513958534 None] Deleting attachment 0f334003-69ff-4f05-aa60-f2bba6bdc300. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:30:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Acquiring lock "cinder-2d218bf9-fda9-4fc4-a486-cecb4a6393a9-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Lock "cinder-2d218bf9-fda9-4fc4-a486-cecb4a6393a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Acquiring lock "cinder-quobyte-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Lock "cinder-quobyte-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:03 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa4a282-a92d-45b3-8f34-cc4f771ff623]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:03 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:30:03 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:04 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 0.809s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:04 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:30:04 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Flow 'volume_create_manager' (74ba48fb-ea5b-4630-bc4b-d5526c2bec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf24a1b-aacb-4601-8e49-660f3e7a099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf24a1b-aacb-4601-8e49-660f3e7a099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1955466867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9567d68-1337-4110-b876-c7f0231cdf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a3efd4de7d48378cf1fe941a2ace88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:04Z,use_quota=True,user_id='985bee5edd6c4aa88b6d91f7f6d5ff8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8277642-01dd-4489-8b2b-3399f2b5b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8277642-01dd-4489-8b2b-3399f2b5b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560a3914-7603-48eb-9448-f7f21a39ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560a3914-7603-48eb-9448-f7f21a39ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9567d68-1337-4110-b876-c7f0231cdf3e', 'volume_name': 'volume-b9567d68-1337-4110-b876-c7f0231cdf3e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dd0380-5d03-47ad-8aa9-20fce11ae39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dd0380-5d03-47ad-8aa9-20fce11ae39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6efcb9-0e7f-4b7f-807e-a2cac9be90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Volume b9567d68-1337-4110-b876-c7f0231cdf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9567d68-1337-4110-b876-c7f0231cdf3e', 'volume_size': 1}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1955466867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9567d68-1337-4110-b876-c7f0231cdf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a3efd4de7d48378cf1fe941a2ace88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:04Z,use_quota=True,user_id='985bee5edd6c4aa88b6d91f7f6d5ff8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Creating volume b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:04 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:04 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e 1073741824
Jun 15 04:30:04 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:05 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 1 in 0.885s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:05 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9
Jun 15 04:30:05 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:05 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e 1073741824" returned: 0 in 0.989s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:05 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:30:05 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:06 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" returned: 0 in 0.917s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Lock "cinder-quobyte-2d218bf9-fda9-4fc4-a486-cecb4a6393a9" released by "delete_volume" :: held 2.690s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.quota [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Created reservations ['c3788d82-fc67-43da-9775-a78332fcd192', 'bbb34e72-71b1-4e44-a7fa-5ba204ab530f', 'f197c9d9-95d5-4c2d-8367-32ea255b1d35', '6487386d-4ecb-479c-9af8-4fee4e021e64'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:06 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:06 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:06 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.877s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6efcb9-0e7f-4b7f-807e-a2cac9be90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9567d68-1337-4110-b876-c7f0231cdf3e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45f05e5-f9d5-463a-a1b6-11f497725019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:06 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Volume volume-b9567d68-1337-4110-b876-c7f0231cdf3e (b9567d68-1337-4110-b876-c7f0231cdf3e): created successfully
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45f05e5-f9d5-463a-a1b6-11f497725019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Flow 'volume_create_manager' (74ba48fb-ea5b-4630-bc4b-d5526c2bec31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-751ef957-b74c-43b3-a27b-514036eb2498 tempest-TestStampPattern-1189422319 None] Created volume successfully.
Jun 15 04:30:07 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.749s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:07 devstack cinder-volume[92103]: DEBUG cinder.manager [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Deleted volume successfully.
Jun 15 04:30:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [req-1d610d5c-efce-41a7-be9a-16a54815d1d7 req-22213570-a92d-46e4-b88b-40842a8d4a11 tempest-TestShelveInstance-1513958534 None] Lock "cinder-2d218bf9-fda9-4fc4-a486-cecb4a6393a9-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "cinder-c1e11f89-9f1d-46cc-80ee-9eda9907828d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-c1e11f89-9f1d-46cc-80ee-9eda9907828d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "cinder-quobyte-c1e11f89-9f1d-46cc-80ee-9eda9907828d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:09 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-quobyte-c1e11f89-9f1d-46cc-80ee-9eda9907828d" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:09 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9abeae-ccdb-4d5e-a486-0e407ed8367b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:09 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d
Jun 15 04:30:09 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:10 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d" returned: 0 in 0.909s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:10 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d
Jun 15 04:30:10 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:11 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c1e11f89-9f1d-46cc-80ee-9eda9907828d" returned: 0 in 0.777s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-quobyte-c1e11f89-9f1d-46cc-80ee-9eda9907828d" released by "delete_volume" :: held 1.759s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Created reservations ['fca18e87-1487-4201-88d0-57a5d1dc7831', '3ba1a627-a116-4e2f-8758-fa732539506e', '3fb69958-ae56-47ee-8058-885f82de69fe', 'e71e5b8b-3f69-4d5d-9665-80b953d2fead'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:11 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:11 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "cinder-d01ebb47-8aed-4407-95b3-8eed8f44b257-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-d01ebb47-8aed-4407-95b3-8eed8f44b257-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "cinder-quobyte-d01ebb47-8aed-4407-95b3-8eed8f44b257" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-quobyte-d01ebb47-8aed-4407-95b3-8eed8f44b257" acquired by "delete_volume" :: waited 0.033s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e2f821-7bce-4fcc-8261-114f4a9973ac]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:12 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257
Jun 15 04:30:12 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:12 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.042s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:12 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Deleted volume successfully.
Jun 15 04:30:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df9030fd-deb8-4f99-b2b9-8c340a132326 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-c1e11f89-9f1d-46cc-80ee-9eda9907828d-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:13 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257" returned: 0 in 1.165s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:13 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257
Jun 15 04:30:13 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:13 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d01ebb47-8aed-4407-95b3-8eed8f44b257" returned: 0 in 0.713s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-quobyte-d01ebb47-8aed-4407-95b3-8eed8f44b257" released by "delete_volume" :: held 1.945s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=62,cinder:SELECT=59,cinder:INSERT=14,cinder:DELETE=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Created reservations ['51bc3437-197b-4986-8db2-9da2d137313f', '094963b9-6879-4109-86d1-203e58c8aaad', '99aeaa14-7c89-40a2-acfc-9c771dfbe13f', 'd55cbb54-9253-41e5-a3d9-7fb7e71d0605'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:14 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:14 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:14 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.627s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Deleted volume successfully.
Jun 15 04:30:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-51455b1a-86eb-49fc-9783-4ab44fc70a15 tempest-TestServerVolumeAttachmentScenario-137337885 None] Lock "cinder-d01ebb47-8aed-4407-95b3-8eed8f44b257-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=62,cinder:UPDATE=67,cinder:INSERT=15,cinder:DELETE=8 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (bfa493f6-8bb6-48df-aa12-daa7c946c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce65a5-5421-4b75-9530-a52231abb7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce65a5-5421-4b75-9530-a52231abb7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125952018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8806fd7e-185e-474e-b817-4dc367325344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:22Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1453d3-0804-4e65-b244-3ef63734cc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1453d3-0804-4e65-b244-3ef63734cc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7000bd-8723-40d7-ae25-9e73ffec9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7000bd-8723-40d7-ae25-9e73ffec9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8806fd7e-185e-474e-b817-4dc367325344', 'volume_name': 'volume-8806fd7e-185e-474e-b817-4dc367325344', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d134f0-037d-455b-bb74-237d0dfe326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d134f0-037d-455b-bb74-237d0dfe326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085196ff-7bd6-496b-a01a-43df99c4a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:22 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume 8806fd7e-185e-474e-b817-4dc367325344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8806fd7e-185e-474e-b817-4dc367325344', 'volume_size': 1}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125952018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8806fd7e-185e-474e-b817-4dc367325344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:22Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating volume 8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:22 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:22 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 1073741824
Jun 15 04:30:22 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:24 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 1073741824" returned: 0 in 1.630s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:24 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344
Jun 15 04:30:24 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:25 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344" returned: 0 in 0.826s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] <== create_volume: return (2548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.551s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (085196ff-7bd6-496b-a01a-43df99c4a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8806fd7e-185e-474e-b817-4dc367325344', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1821d19-19c9-4362-b4bc-4aaa8649d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:25 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume volume-8806fd7e-185e-474e-b817-4dc367325344 (8806fd7e-185e-474e-b817-4dc367325344): created successfully
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1821d19-19c9-4362-b4bc-4aaa8649d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (bfa493f6-8bb6-48df-aa12-daa7c946c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:25 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-574acf45-e05a-491b-bd96-f9f836ff4e00 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created volume successfully.
Jun 15 04:30:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating offline snapshot e2a4cb2c-b73b-404a-83ac-1e3a643db508 of volume 8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:30:26 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[560875dd-08fa-4011-bde9-d6c430218b16]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:26 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344
Jun 15 04:30:26 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:27 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344" returned: 0 in 1.505s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:28 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 1G
Jun 15 04:30:28 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:29 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 1G" returned: 0 in 1.539s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8806fd7e-185e-474e-b817-4dc367325344 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:29 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8806fd7e-185e-474e-b817-4dc367325344 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508
Jun 15 04:30:29 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:30 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8806fd7e-185e-474e-b817-4dc367325344 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508" returned: 0 in 1.266s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:30 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 is being set with open permissions: ugo+rw
Jun 15 04:30:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:30 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508
Jun 15 04:30:30 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:32 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508" returned: 0 in 1.365s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:32 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info
Jun 15 04:30:32 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:33 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info" returned: 0 in 1.392s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:33 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info is being set with open permissions: ugo+rw
Jun 15 04:30:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:33 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info
Jun 15 04:30:33 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:34 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.info" returned: 0 in 0.941s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.246s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:34 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-53fd090f-4d02-42ad-ac49-e6f5ecd5681c tempest-CreateVolumesFromSnapshotTest-1243879392 None] Create snapshot completed successfully
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:35 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:35 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:35 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (538d1ed0-1a2b-442f-a438-d0648c407f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37322d9b-b8bf-4be4-afc2-95281c9e6bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37322d9b-b8bf-4be4-afc2-95281c9e6bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14935094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:36Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09af50b0-0b81-46e0-8b8f-3cd010a59642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09af50b0-0b81-46e0-8b8f-3cd010a59642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecbfef6-b111-4a83-a4bd-042165b0f48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecbfef6-b111-4a83-a4bd-042165b0f48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9', 'volume_name': 'volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83e5142-b9f0-441e-894e-ad15708f27d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83e5142-b9f0-441e-894e-ad15708f27d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c886e50c-3e60-4d98-98c7-60fcc00f1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:36 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9', 'volume_size': 1}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14935094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:36Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating volume e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:36 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:36 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 1073741824
Jun 15 04:30:36 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (dfaa8306-0dad-4469-a68f-4bfa3f142128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111300a4-38e5-48b1-94f9-d2ff84f76610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111300a4-38e5-48b1-94f9-d2ff84f76610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1118114064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ae90f9-a012-48a0-9593-c7b375697772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:37Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8077c8d3-4a66-4c34-bd7b-369555ef18a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8077c8d3-4a66-4c34-bd7b-369555ef18a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ef4f18-09f2-45c4-808f-191a29b41782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ef4f18-09f2-45c4-808f-191a29b41782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ae90f9-a012-48a0-9593-c7b375697772', 'volume_name': 'volume-60ae90f9-a012-48a0-9593-c7b375697772', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:37 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d729ce2-8368-4f69-9a6b-9f7352f1e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d729ce2-8368-4f69-9a6b-9f7352f1e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605d4333-765e-4a4e-b604-23246e0a837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume 60ae90f9-a012-48a0-9593-c7b375697772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ae90f9-a012-48a0-9593-c7b375697772', 'volume_size': 1}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.787s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:30:37 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 1073741824" returned: 0 in 1.323s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:37 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9
Jun 15 04:30:37 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (58f601a2-24e5-43af-bccd-edf42b6989f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9531d6f-f42b-4d34-965b-620d9a6c813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9531d6f-f42b-4d34-965b-620d9a6c813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457215671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2abec2-a988-45b1-bbd8-33d5376ae997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:38Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fc96bc-25eb-48a9-b953-d7bec28e2a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fc96bc-25eb-48a9-b953-d7bec28e2a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c323f185-6272-42d7-b393-8c2bcbcc0af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c323f185-6272-42d7-b393-8c2bcbcc0af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2abec2-a988-45b1-bbd8-33d5376ae997', 'volume_name': 'volume-7b2abec2-a988-45b1-bbd8-33d5376ae997', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b3c67d-b765-4596-af3b-d985bce74d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b3c67d-b765-4596-af3b-d985bce74d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9ce464-d5db-4140-93df-c529fe69d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume 7b2abec2-a988-45b1-bbd8-33d5376ae997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2abec2-a988-45b1-bbd8-33d5376ae997', 'volume_size': 1}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Flow 'volume_create_manager' (96a8656f-e8c4-4aef-8ace-e4f7e26ac31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ff739d-78a2-4e90-89a2-9c0c78c1dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ff739d-78a2-4e90-89a2-9c0c78c1dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cee8a9-ad0c-4590-bee9-55e33ca8d410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef631ea082b340e5bd8d3c2918c61eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:38Z,use_quota=True,user_id='2d3e638fa89a4fbd8ee2c7ce5bcfbc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb61a3f3-a37f-4f1a-9b91-b865fe1bf541),volume_type_id=fb61a3f3-a37f-4f1a-9b91-b865fe1bf541)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dc6b49-068d-4980-9471-df2294260176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dc6b49-068d-4980-9471-df2294260176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caee1430-5603-443a-a768-48f6d547c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (6a19d49b-81bf-4f80-b1ed-380841493231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5da5fd1-46fd-45a5-924a-ff43f1e64caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5da5fd1-46fd-45a5-924a-ff43f1e64caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-287405785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb451bc3-eb7e-4f9e-977e-aacd362fd887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:38Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564cf226-a2e8-408f-9be8-d5f1c40fcb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564cf226-a2e8-408f-9be8-d5f1c40fcb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e123874d-7cb8-4562-9b42-f3d4c2a331d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e123874d-7cb8-4562-9b42-f3d4c2a331d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb451bc3-eb7e-4f9e-977e-aacd362fd887', 'volume_name': 'volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f32cef8-a7d8-4d25-823e-d6b297d05898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f32cef8-a7d8-4d25-823e-d6b297d05898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e431a24-3063-4d65-b1e8-935b34be35e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume bb451bc3-eb7e-4f9e-977e-aacd362fd887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887', 'volume_size': 1}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:38 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9" returned: 0 in 1.253s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.647s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1118114064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ae90f9-a012-48a0-9593-c7b375697772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:37Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating volume 60ae90f9-a012-48a0-9593-c7b375697772 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:38 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c886e50c-3e60-4d98-98c7-60fcc00f1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772 1073741824
Jun 15 04:30:38 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d766f81d-90a5-4020-89b1-65e9177a0b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:38 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 (e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9): created successfully
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d766f81d-90a5-4020-89b1-65e9177a0b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (538d1ed0-1a2b-442f-a438-d0648c407f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0077f590-4ea8-472a-9231-67b10b1eb2b5 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created volume successfully.
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caee1430-5603-443a-a768-48f6d547c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5cee8a9-ad0c-4590-bee9-55e33ca8d410', 'volume_name': 'volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410', 'volume_size': 1, 'image_id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b4ff9e0b0aef5dd522b4ea3a33d6415', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef631ea082b340e5bd8d3c2918c61eaf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6109877c17b8bd999d788ef1ef57c70b59b29580095250c116af2a45e89223e04a05aca2c538ae9934c9c527b024d2b21330772b0f6a76fe1b7942b9279001e5', 'id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'created_at': datetime.datetime(2026, 6, 15, 2, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 30, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496ce989bb0>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbe41c3-bdb4-4e94-b135-1a70e5369302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbe41c3-bdb4-4e94-b135-1a70e5369302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfd77fa-5b62-444e-bfef-0ee36bcf9983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Volume f5cee8a9-ad0c-4590-bee9-55e33ca8d410: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410', 'volume_size': 1, 'image_id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b4ff9e0b0aef5dd522b4ea3a33d6415', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef631ea082b340e5bd8d3c2918c61eaf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6109877c17b8bd999d788ef1ef57c70b59b29580095250c116af2a45e89223e04a05aca2c538ae9934c9c527b024d2b21330772b0f6a76fe1b7942b9279001e5', 'id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'created_at': datetime.datetime(2026, 6, 15, 2, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 30, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496ce989bb0>}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Trying to clone f5cee8a9-ad0c-4590-bee9-55e33ca8d410 from image edb2fc60-b880-4367-91d7-79e7a9a09ecf at location (None, [{'url': 'file:///opt/stack/data/glance/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (51a905f0-1d6c-4224-993e-4573281f5a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be2580f-c20d-43a4-aa42-2d912d627342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be2580f-c20d-43a4-aa42-2d912d627342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774345478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e7d843-93d4-46db-9585-add5dd02e516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:39Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25a3c12-b378-49ba-ab4d-d1fee68aa023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25a3c12-b378-49ba-ab4d-d1fee68aa023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47488823-eb1d-4f4b-b032-96ca858beedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47488823-eb1d-4f4b-b032-96ca858beedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e7d843-93d4-46db-9585-add5dd02e516', 'volume_name': 'volume-b4e7d843-93d4-46db-9585-add5dd02e516', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc424a-d3d5-4063-a498-f73bf202a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc424a-d3d5-4063-a498-f73bf202a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35f6356-551f-4593-9c7b-8ca775bbfb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:39 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume b4e7d843-93d4-46db-9585-add5dd02e516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e7d843-93d4-46db-9585-add5dd02e516', 'volume_size': 1}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:30:39 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eac2064-544d-4d46-953a-b5056e438d74]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:39 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD
Jun 15 04:30:39 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:39 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772 1073741824" returned: 0 in 1.152s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:40 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772
Jun 15 04:30:40 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:40 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:40 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD
Jun 15 04:30:40 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:40 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772" returned: 0 in 0.679s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.334s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-457215671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2abec2-a988-45b1-bbd8-33d5376ae997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:38Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating volume 7b2abec2-a988-45b1-bbd8-33d5376ae997 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605d4333-765e-4a4e-b604-23246e0a837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ae90f9-a012-48a0-9593-c7b375697772', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:40 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 1073741824
Jun 15 04:30:40 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31db7973-b785-43ca-b75a-c1c1c2c3aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:40 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume volume-60ae90f9-a012-48a0-9593-c7b375697772 (60ae90f9-a012-48a0-9593-c7b375697772): created successfully
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31db7973-b785-43ca-b75a-c1c1c2c3aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (dfaa8306-0dad-4469-a68f-4bfa3f142128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:40 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d2dba9b8-134d-46ec-9ec7-f94209bc5b2f tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created volume successfully.
Jun 15 04:30:41 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Temporary image edb2fc60-b880-4367-91d7-79e7a9a09ecf is fetched for user 2d3e638fa89a4fbd8ee2c7ce5bcfbc06. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc20c14-9f67-4f96-88c4-1b18e0bec01f]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:41 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD
Jun 15 04:30:41 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:41 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 1073741824" returned: 0 in 0.857s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:41 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997
Jun 15 04:30:41 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:41 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:42 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD
Jun 15 04:30:42 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:42 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997" returned: 0 in 0.599s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.481s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-287405785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb451bc3-eb7e-4f9e-977e-aacd362fd887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:38Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating volume bb451bc3-eb7e-4f9e-977e-aacd362fd887 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:42 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9ce464-d5db-4140-93df-c529fe69d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2abec2-a988-45b1-bbd8-33d5376ae997', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:42 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 1073741824
Jun 15 04:30:42 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47667631-1951-414d-909c-3cdcf2d4d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:42 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 (7b2abec2-a988-45b1-bbd8-33d5376ae997): created successfully
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47667631-1951-414d-909c-3cdcf2d4d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (58f601a2-24e5-43af-bccd-edf42b6989f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-155b4a08-b691-4f53-92e2-a6aacc098624 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created volume successfully.
Jun 15 04:30:42 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD" returned: 1 in 0.728s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:42 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 1073741824" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:43 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887
Jun 15 04:30:43 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:43 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887" returned: 0 in 0.639s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.272s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774345478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e7d843-93d4-46db-9585-add5dd02e516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a2329fc1504feb94972cb5ce8db03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:39Z,use_quota=True,user_id='f940699bead447cd9da94c1f22161a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Creating volume b4e7d843-93d4-46db-9585-add5dd02e516 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:43 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e431a24-3063-4d65-b1e8-935b34be35e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:43 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516 1073741824
Jun 15 04:30:43 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba81819-73b9-4fa8-ada6-f5b2cc48f272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:43 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 (bb451bc3-eb7e-4f9e-977e-aacd362fd887): created successfully
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba81819-73b9-4fa8-ada6-f5b2cc48f272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:43 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (6a19d49b-81bf-4f80-b1ed-380841493231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:43 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-bfa822bf-0fe9-463c-83f7-94e1ae88cc81 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created volume successfully.
Jun 15 04:30:44 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516 1073741824" returned: 0 in 0.775s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:44 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516
Jun 15 04:30:44 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:45 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516" returned: 0 in 0.619s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cee8a9-ad0c-4590-bee9-55e33ca8d410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef631ea082b340e5bd8d3c2918c61eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:38Z,use_quota=True,user_id='2d3e638fa89a4fbd8ee2c7ce5bcfbc06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb61a3f3-a37f-4f1a-9b91-b865fe1bf541),volume_type_id=fb61a3f3-a37f-4f1a-9b91-b865fe1bf541)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Creating volume f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:45 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:45 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 1073741824
Jun 15 04:30:45 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35f6356-551f-4593-9c7b-8ca775bbfb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e7d843-93d4-46db-9585-add5dd02e516', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b9a61-919b-4689-b7f0-598178046046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:45 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Volume volume-b4e7d843-93d4-46db-9585-add5dd02e516 (b4e7d843-93d4-46db-9585-add5dd02e516): created successfully
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b9a61-919b-4689-b7f0-598178046046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Flow 'volume_create_manager' (51a905f0-1d6c-4224-993e-4573281f5a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-bd11f9ea-35e4-4b51-ba4f-50881c1bb7c4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created volume successfully.
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-b4e7d843-93d4-46db-9585-add5dd02e516-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-b4e7d843-93d4-46db-9585-add5dd02e516-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-b4e7d843-93d4-46db-9585-add5dd02e516" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-b4e7d843-93d4-46db-9585-add5dd02e516" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e481a8-0654-423e-a560-313c34ad55d8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:46 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 1073741824" returned: 0 in 0.899s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:46 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:46 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:46 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516
Jun 15 04:30:46 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:46 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 0 in 0.620s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Attempting download of edb2fc60-b880-4367-91d7-79e7a9a09ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'metadata': {}}])) to volume f5cee8a9-ad0c-4590-bee9-55e33ca8d410. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b516b5-ed6f-4995-8b1c-d9bdc7bc5142]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:46 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516" returned: 0 in 0.803s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:46 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516
Jun 15 04:30:46 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:46 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw
Jun 15 04:30:46 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:47 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b4e7d843-93d4-46db-9585-add5dd02e516" returned: 0 in 0.639s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-b4e7d843-93d4-46db-9585-add5dd02e516" released by "delete_volume" :: held 1.495s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:47 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw" returned: 0 in 0.698s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['bead9d23-afd2-4aa0-8cfd-657ab92b3c39', 'b2357e29-687e-44ce-a594-828e349ad537', 'c8baa371-9b7f-4394-ae63-3aa100ce74e3', '44164d7a-fa69-4e06-972e-8b5caa171470'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:47 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw
Jun 15 04:30:47 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:47 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:47 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-bb451bc3-eb7e-4f9e-977e-aacd362fd887-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-bb451bc3-eb7e-4f9e-977e-aacd362fd887-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-bb451bc3-eb7e-4f9e-977e-aacd362fd887" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:48 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:48 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw" returned: 1 in 0.741s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb2fc60-b880-4367-91d7-79e7a9a09ecf_fesh0fnw' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.624s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f075db-a8da-4384-879f-35adaf8ba975]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleted volume successfully.
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-bb451bc3-eb7e-4f9e-977e-aacd362fd887" acquired by "delete_volume" :: waited 0.043s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5cf6c-9f79-45a9-a145-55dc17af50ec]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6c1fa87b-765d-467a-96df-93ce8955d795 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-b4e7d843-93d4-46db-9585-add5dd02e516-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:48 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD
Jun 15 04:30:48 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:48 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887
Jun 15 04:30:48 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:48 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:48 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887" returned: 0 in 0.742s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:49 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887
Jun 15 04:30:49 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD
Jun 15 04:30:49 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:49 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:49 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:49 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD" returned: 1 in 0.702s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] edb2fc60-b880-4367-91d7-79e7a9a09ecf was raw, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bb451bc3-eb7e-4f9e-977e-aacd362fd887" returned: 0 in 0.639s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-bb451bc3-eb7e-4f9e-977e-aacd362fd887" released by "delete_volume" :: held 1.430s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:49 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:49 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['03989796-4f0f-4f38-87ec-20280095806f', 'aebd382f-5afa-4282-b9be-8486d2b79988', 'babf3d80-0031-4182-a2e5-ace5955b4615', '15dd6821-4127-454e-854d-c8746be4b4f0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:49 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:49 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-7b2abec2-a988-45b1-bbd8-33d5376ae997-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-7b2abec2-a988-45b1-bbd8-33d5376ae997-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:50 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 0 in 0.804s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edb2fc60-b880-4367-91d7-79e7a9a09ecf_nx2si2dgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:30:50 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:50 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-7b2abec2-a988-45b1-bbd8-33d5376ae997" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.663s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:50 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 1G
Jun 15 04:30:50 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleted volume successfully.
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-7b2abec2-a988-45b1-bbd8-33d5376ae997" acquired by "delete_volume" :: waited 0.042s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-56a91482-7109-4a7b-a90b-877a912226cb tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-bb451bc3-eb7e-4f9e-977e-aacd362fd887-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e7c87-c3c1-4a23-afa1-e09a2afaf3ba]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:50 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997
Jun 15 04:30:50 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:51 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 1G" returned: 0 in 0.713s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf12c247-418f-420a-bc99-4c92947d122f]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:51 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997" returned: 0 in 0.747s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:51 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:51 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:51 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997
Jun 15 04:30:51 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:51 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 0 in 0.710s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:51 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7b2abec2-a988-45b1-bbd8-33d5376ae997" returned: 0 in 0.647s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-7b2abec2-a988-45b1-bbd8-33d5376ae997" released by "delete_volume" :: held 1.438s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:51 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['a8f82b9c-a8d5-43d9-a763-40eef19fb618', '61e43956-e068-4e17-b664-f4278da245c2', 'e79d8cb1-5e7c-4f84-a5da-eb05371da347', '09312c94-c039-436b-ac38-8da95a3f198f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:52 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:52 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:52 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:52 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:52 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 1 in 0.718s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Downloaded image edb2fc60-b880-4367-91d7-79e7a9a09ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'metadata': {}}])) to volume f5cee8a9-ad0c-4590-bee9-55e33ca8d410 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Temporary image edb2fc60-b880-4367-91d7-79e7a9a09ecf for user 2d3e638fa89a4fbd8ee2c7ce5bcfbc06 is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Marking volume f5cee8a9-ad0c-4590-bee9-55e33ca8d410 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-60ae90f9-a012-48a0-9593-c7b375697772-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Copying metadata from image edb2fc60-b880-4367-91d7-79e7a9a09ecf to f5cee8a9-ad0c-4590-bee9-55e33ca8d410. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Creating volume glance metadata for volume f5cee8a9-ad0c-4590-bee9-55e33ca8d410 backed by image edb2fc60-b880-4367-91d7-79e7a9a09ecf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4b4ff9e0b0aef5dd522b4ea3a33d6415', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-60ae90f9-a012-48a0-9593-c7b375697772-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:52 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.614s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleted volume successfully.
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-60ae90f9-a012-48a0-9593-c7b375697772" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-982354e5-dc8f-4cbd-b7cd-c7ee6187fced tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-7b2abec2-a988-45b1-bbd8-33d5376ae997-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-60ae90f9-a012-48a0-9593-c7b375697772" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0ad524-a099-439d-92aa-89593b3b1f95]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfd77fa-5b62-444e-bfef-0ee36bcf9983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410', 'volume_size': 1, 'image_id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b4ff9e0b0aef5dd522b4ea3a33d6415', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef631ea082b340e5bd8d3c2918c61eaf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6109877c17b8bd999d788ef1ef57c70b59b29580095250c116af2a45e89223e04a05aca2c538ae9934c9c527b024d2b21330772b0f6a76fe1b7942b9279001e5', 'id': 'edb2fc60-b880-4367-91d7-79e7a9a09ecf', 'created_at': datetime.datetime(2026, 6, 15, 2, 30, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 30, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb2fc60-b880-4367-91d7-79e7a9a09ecf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496ce989bb0>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df640176-6bc2-4562-b061-7b55b4a4a45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:52 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Volume volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 (f5cee8a9-ad0c-4590-bee9-55e33ca8d410): created successfully
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df640176-6bc2-4562-b061-7b55b4a4a45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:52 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Flow 'volume_create_manager' (96a8656f-e8c4-4aef-8ace-e4f7e26ac31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8d779e94-b6f1-4657-9cc3-bb528b5cd37a tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Created volume successfully.
Jun 15 04:30:52 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772
Jun 15 04:30:52 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Acquiring lock "cinder-f5cee8a9-ad0c-4590-bee9-55e33ca8d410-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "cinder-f5cee8a9-ad0c-4590-bee9-55e33ca8d410-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Acquiring lock "cinder-quobyte-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "cinder-quobyte-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dc3fed-2b9b-4f08-9791-8b765ca680ce]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:53 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:53 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:53 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772" returned: 0 in 0.885s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:53 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772
Jun 15 04:30:53 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Flow 'volume_create_manager' (77977cf5-34d7-42aa-8a0d-7d2a7820d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaa7732-88d7-4461-ac18-1146a67e51bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaa7732-88d7-4461-ac18-1146a67e51bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1900714006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0029743a845647789425c17cf697f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:54Z,use_quota=True,user_id='e6110f5b1c6c4dfd8e51b202d53c7f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9691ce56-7be1-498d-aa05-c844836fcd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9691ce56-7be1-498d-aa05-c844836fcd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d71e7c9-651d-4a46-902b-6e1117afff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d71e7c9-651d-4a46-902b-6e1117afff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca', 'volume_name': 'volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3caae5f-728f-4c6f-945d-d537da3dd401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3caae5f-728f-4c6f-945d-d537da3dd401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd98f6a4-ba3f-4238-9fd5-a4cf5271fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:53 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Volume 2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca', 'volume_size': 1}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1900714006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0029743a845647789425c17cf697f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:30:54Z,use_quota=True,user_id='e6110f5b1c6c4dfd8e51b202d53c7f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Creating volume 2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:30:53 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:30:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:53 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca 1073741824
Jun 15 04:30:53 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:54 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 0 in 0.851s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:54 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:54 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:54 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-60ae90f9-a012-48a0-9593-c7b375697772" returned: 0 in 0.728s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-60ae90f9-a012-48a0-9593-c7b375697772" released by "delete_volume" :: held 1.661s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['9a8d3c0f-2816-405c-a6e2-e6ed9f72f4fb', 'a1329f3a-662b-498e-be7c-ec17151fbb63', 'dfbf053c-87cc-4aa2-b64d-7b7f6ddba569', 'f67bc3bf-dc9a-4d49-a8fb-3d2b79b2a26c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:54 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:54 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:54 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca 1073741824" returned: 0 in 0.843s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:54 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca
Jun 15 04:30:54 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:54 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 1 in 0.810s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:54 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410
Jun 15 04:30:54 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d1a06e-9886-4813-8d95-60a255ffebb5]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:55 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9
Jun 15 04:30:55 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:55 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.744s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:55 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleted volume successfully.
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57a0071-423e-46fb-8759-cae2dfe227a4 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-60ae90f9-a012-48a0-9593-c7b375697772-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:55 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" returned: 0 in 0.746s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd98f6a4-ba3f-4238-9fd5-a4cf5271fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a337b77-fd72-4bdd-be06-f2cd98731fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:30:55 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Volume volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca (2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca): created successfully
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a337b77-fd72-4bdd-be06-f2cd98731fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Flow 'volume_create_manager' (77977cf5-34d7-42aa-8a0d-7d2a7820d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:30:55 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-dd14170f-df1e-4541-a836-95eb0c3ccea6 tempest-AttachVolumeNegativeTest-393846504 None] Created volume successfully.
Jun 15 04:30:55 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" returned: 0 in 0.715s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "cinder-quobyte-f5cee8a9-ad0c-4590-bee9-55e33ca8d410" released by "delete_volume" :: held 2.455s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:55 devstack cinder-volume[92103]: WARNING cinder.quota [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:30:55 devstack cinder-volume[92103]: WARNING cinder.quota [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Created reservations ['9e0b9251-ca06-4980-8d19-c386578c4665', 'd3e4e2fe-ec81-4249-9ea2-6658a1710200', '513aadf5-2195-4fc2-a337-0fbf129d68d4', '9eb4fcea-27f9-4098-952b-d26cd47bd948'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:55 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:55 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:55 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9" returned: 0 in 0.808s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:55 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9
Jun 15 04:30:55 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:56 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.675s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:56 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Deleted volume successfully.
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-55eb4717-b70b-4ae0-abe9-7eab3e58b253 tempest-VolumeAndVolumeTypeFromImageTest-1088707472 None] Lock "cinder-f5cee8a9-ad0c-4590-bee9-55e33ca8d410-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:56 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9" returned: 0 in 0.681s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9" released by "delete_volume" :: held 1.541s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['fb9d8616-7144-40c1-9c7d-82ce28277638', 'ae1d2902-609b-4481-a852-a9831e6c20b1', 'bdc29bde-cf43-4fb0-b9c7-75acd16e9c08', '777f5d87-5137-449d-b182-1cfa8d7a218b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027fea9-e566-40e9-8ad3-28122947c90a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:56 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:30:56 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:56 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:30:56 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-e2a4cb2c-b73b-404a-83ac-1e3a643db508-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-e2a4cb2c-b73b-404a-83ac-1e3a643db508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-8806fd7e-185e-474e-b817-4dc367325344" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-8806fd7e-185e-474e-b817-4dc367325344" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-e2a4cb2c-b73b-404a-83ac-1e3a643db508" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-e2a4cb2c-b73b-404a-83ac-1e3a643db508" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleting offline snapshot e2a4cb2c-b73b-404a-83ac-1e3a643db508 of volume 8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] snapshot_file for this snap is: volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d25b7-a3c5-4dc6-86ed-c3ef41e3254a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:57 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.719s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:30:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleted volume successfully.
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6bfa8c68-07b3-40f1-9674-8c96b9707426 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-e6a8b24e-3c73-4f9e-8a61-d25e238ca4d9-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:30:57 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508
Jun 15 04:30:57 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:57 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.887s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:30:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-b9567d68-1337-4110-b876-c7f0231cdf3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bdf7ce1-421f-438d-81ff-35ba5dd69e34', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:30:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-7b2b77e0-4700-4aca-8431-376d29d9c4fb req-7fb914a0-14be-4beb-91eb-90da73f09bc8 tempest-TestStampPattern-1189422319 None] attachment_update completed successfully.
Jun 15 04:30:58 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508" returned: 0 in 0.913s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8806fd7e-185e-474e-b817-4dc367325344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:30:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8da7ff-0dd1-429d-bad4-2ba222f7f396]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:58 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344
Jun 15 04:30:58 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:59 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Jun 15 04:30:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344" returned: 0 in 0.929s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:30:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:59 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508
Jun 15 04:30:59 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:30:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:30:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:30:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b3e152-7926-4aae-9c93-34e07776f4e4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:30:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:30:59 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca
Jun 15 04:30:59 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:00 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508" returned: 0 in 0.918s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:00 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508
Jun 15 04:31:00 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:00 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" returned: 0 in 0.876s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56abe20a-390a-43af-8649-1e54c4ffec82', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:31:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-e8be3aac-861c-4ca1-b3b2-4a1e09391288 req-e2d6f774-f5af-4a79-9897-e44b322803cc tempest-AttachVolumeNegativeTest-393846504 None] attachment_update completed successfully.
Jun 15 04:31:00 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344.e2a4cb2c-b73b-404a-83ac-1e3a643db508" returned: 0 in 0.749s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-e2a4cb2c-b73b-404a-83ac-1e3a643db508" released by "_delete_snapshot" :: held 3.662s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-8806fd7e-185e-474e-b817-4dc367325344" released by "delete_snapshot" :: held 3.692s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['2a228f43-b5ba-446c-85b3-df6084941f1f', '3e6e7ab0-018c-4628-96af-6b093a37c88e', 'eded5229-d1d4-49ef-a04e-71723a63b365', '1092dde4-a40d-4681-942a-6e366e6399b8'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Delete snapshot completed successfully.
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4166d25e-f70f-4745-9f27-4eac3c2e26f2 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-e2a4cb2c-b73b-404a-83ac-1e3a643db508-delete_snapshot" released by "delete_snapshot" :: held 3.856s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (ce6aef09-9497-476f-a2db-929533e925e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2f36ed-8177-4405-b360-dc437ae428d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2f36ed-8177-4405-b360-dc437ae428d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235208679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:01Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b7bf97-a7a4-4247-b5a6-be6e85abf8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b7bf97-a7a4-4247-b5a6-be6e85abf8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9702ed24-8586-47b7-8304-efa6ed50e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9702ed24-8586-47b7-8304-efa6ed50e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145', 'volume_name': 'volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e5a09-6d43-4047-a526-eeb54148c43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e5a09-6d43-4047-a526-eeb54148c43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b475458d-3aeb-49e9-afb6-473e65047cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:01 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Volume fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145', 'volume_size': 1}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235208679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:01Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Creating volume fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:01 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:01 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 1073741824
Jun 15 04:31:01 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (2d5116d9-a65f-467a-ad40-ce10fac33b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ccc09-4ab8-44c2-9766-2aa1783c1e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-8806fd7e-185e-474e-b817-4dc367325344-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ccc09-4ab8-44c2-9766-2aa1783c1e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1851008499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99677eb2-9cf0-484a-b533-68ee3e6ca01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:02Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f22fe-b8ad-4c7f-9751-6cfbc900d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f22fe-b8ad-4c7f-9751-6cfbc900d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8820cf02-73dc-4acb-a1ff-bb100fae73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8820cf02-73dc-4acb-a1ff-bb100fae73ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99677eb2-9cf0-484a-b533-68ee3e6ca01a', 'volume_name': 'volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89ce37b-bc5e-44b3-89ac-2c4bfdb863e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89ce37b-bc5e-44b3-89ac-2c4bfdb863e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781fa4d0-25fd-4c06-92ce-3aab8e055646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Volume 99677eb2-9cf0-484a-b533-68ee3e6ca01a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a', 'volume_size': 1}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-8806fd7e-185e-474e-b817-4dc367325344-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "cinder-quobyte-8806fd7e-185e-474e-b817-4dc367325344" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-8806fd7e-185e-474e-b817-4dc367325344" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f4c87d-8f03-456a-8e75-25446e608bc6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:02 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344
Jun 15 04:31:02 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (aa9e5753-09c7-4bb8-8378-9ab426f0fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d873e9f5-245c-4e88-9a18-268daafdf3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d873e9f5-245c-4e88-9a18-268daafdf3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433114557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586e5e0-bdae-41eb-b8db-2ff0042aa701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:02Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2e84d2-8475-4557-8a95-bdb5b4a25b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2e84d2-8475-4557-8a95-bdb5b4a25b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53fe377-9729-4488-9bcc-88d974694484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53fe377-9729-4488-9bcc-88d974694484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c586e5e0-bdae-41eb-b8db-2ff0042aa701', 'volume_name': 'volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0b45fd-3455-4aa5-a1d1-4626b7acd66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0b45fd-3455-4aa5-a1d1-4626b7acd66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35ab2d0-1efd-42d3-91db-8ba4e4ae9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Volume c586e5e0-bdae-41eb-b8db-2ff0042aa701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701', 'volume_size': 1}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 1073741824" returned: 0 in 1.119s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:02 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145
Jun 15 04:31:02 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (729d7524-9622-48f0-832b-93f3d4e7ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2db34f-bacb-4e6d-aa61-4bcbcff957d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2db34f-bacb-4e6d-aa61-4bcbcff957d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941483893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef77719d-4d83-4a5d-babb-6ec9dd9a243f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:03Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd53cb23-c410-4882-858f-c76d6c27c4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd53cb23-c410-4882-858f-c76d6c27c4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c018201-cc33-45e5-9fba-3fad8906fbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c018201-cc33-45e5-9fba-3fad8906fbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef77719d-4d83-4a5d-babb-6ec9dd9a243f', 'volume_name': 'volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125a8204-2f92-457c-8a46-cd62b508226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125a8204-2f92-457c-8a46-cd62b508226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134fc4d0-3940-47c1-9370-2ba45e59f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Volume ef77719d-4d83-4a5d-babb-6ec9dd9a243f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f', 'volume_size': 1}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:03 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (52c0babf-2b12-40c8-ad8e-e72860b96ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa0c142-46ae-44d9-8b1b-7cadeae1c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344" returned: 0 in 1.141s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa0c142-46ae-44d9-8b1b-7cadeae1c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1726189609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5756980-fddb-4de3-91c7-f28824c2b39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:03Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368c71c-6c21-41a0-aa2f-e1c81c37ca62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344
Jun 15 04:31:03 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368c71c-6c21-41a0-aa2f-e1c81c37ca62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c3a26f-4fa1-4154-a089-d3660dc110f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c3a26f-4fa1-4154-a089-d3660dc110f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5756980-fddb-4de3-91c7-f28824c2b39f', 'volume_name': 'volume-d5756980-fddb-4de3-91c7-f28824c2b39f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3e599c-e86b-4198-acd2-1ac3ab010fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3e599c-e86b-4198-acd2-1ac3ab010fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ef1633-b894-405b-a9d5-8c7a1a8e468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Volume d5756980-fddb-4de3-91c7-f28824c2b39f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5756980-fddb-4de3-91c7-f28824c2b39f', 'volume_size': 1}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:03 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145" returned: 0 in 0.852s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1851008499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99677eb2-9cf0-484a-b533-68ee3e6ca01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:02Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Creating volume 99677eb2-9cf0-484a-b533-68ee3e6ca01a {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:03 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b475458d-3aeb-49e9-afb6-473e65047cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a 1073741824
Jun 15 04:31:03 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822c22c6-c187-40ac-b669-569f097ea69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Volume volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 (fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145): created successfully
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822c22c6-c187-40ac-b669-569f097ea69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (ce6aef09-9497-476f-a2db-929533e925e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:03 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1cb589e4-d113-4532-a801-e83bfad1b0af tempest-CreateVolumesFromImageTest-928869044 None] Created volume successfully.
Jun 15 04:31:04 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-8806fd7e-185e-474e-b817-4dc367325344" returned: 0 in 0.696s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-quobyte-8806fd7e-185e-474e-b817-4dc367325344" released by "delete_volume" :: held 1.915s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Created reservations ['5b96d186-167a-4937-914c-511e8f24b756', 'a604d8d3-a148-424c-a1c6-7a56974492b8', '47e98fb7-6af0-4824-ad21-5af39c594d88', '563317eb-ac23-4941-af17-96b80348296c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:04 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:04 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:04 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a 1073741824" returned: 0 in 0.990s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:04 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a
Jun 15 04:31:04 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:05 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.848s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Deleted volume successfully.
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9ec1081e-c9f8-49bd-8db7-3d9297a7bca9 tempest-CreateVolumesFromSnapshotTest-1243879392 None] Lock "cinder-8806fd7e-185e-474e-b817-4dc367325344-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:05 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a" returned: 0 in 0.665s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.638s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433114557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c586e5e0-bdae-41eb-b8db-2ff0042aa701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:02Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Creating volume c586e5e0-bdae-41eb-b8db-2ff0042aa701 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:05 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781fa4d0-25fd-4c06-92ce-3aab8e055646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:05 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 1073741824
Jun 15 04:31:05 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35af959-1e56-4708-ac0e-320ed4d8bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:05 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Volume volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a (99677eb2-9cf0-484a-b533-68ee3e6ca01a): created successfully
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35af959-1e56-4708-ac0e-320ed4d8bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:05 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (2d5116d9-a65f-467a-ad40-ce10fac33b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-df4fedda-2c41-4dc9-a8ea-6bdcbccbae83 tempest-CreateVolumesFromImageTest-928869044 None] Created volume successfully.
Jun 15 04:31:06 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 1073741824" returned: 0 in 1.123s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:06 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701
Jun 15 04:31:06 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:07 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701" returned: 0 in 0.608s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.038s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941483893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef77719d-4d83-4a5d-babb-6ec9dd9a243f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:03Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Creating volume ef77719d-4d83-4a5d-babb-6ec9dd9a243f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:07 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35ab2d0-1efd-42d3-91db-8ba4e4ae9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:07 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f 1073741824
Jun 15 04:31:07 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8567b09a-330c-453b-8c0a-03c358ed82fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:07 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Volume volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 (c586e5e0-bdae-41eb-b8db-2ff0042aa701): created successfully
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8567b09a-330c-453b-8c0a-03c358ed82fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (aa9e5753-09c7-4bb8-8378-9ab426f0fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8595f057-5e10-4e4f-bf56-9555ce4f96ca tempest-CreateVolumesFromImageTest-928869044 None] Created volume successfully.
Jun 15 04:31:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-b9df3ef6-5d11-4e15-b906-8c5331b85c66 req-fe5d1e12-83b1-4ef0-a94e-1ba0bb99f1b6 tempest-AttachVolumeNegativeTest-393846504 None] Terminate volume connection completed successfully.
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-b9df3ef6-5d11-4e15-b906-8c5331b85c66 req-fe5d1e12-83b1-4ef0-a94e-1ba0bb99f1b6 tempest-AttachVolumeNegativeTest-393846504 None] Deleting attachment 56abe20a-390a-43af-8649-1e54c4ffec82. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:31:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-c0ac7502-49ba-47a0-9ac9-e85e22fff0ce req-a065a496-c54d-4f43-89a9-3828391fdff1 tempest-TestStampPattern-1189422319 None] Terminate volume connection completed successfully.
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-c0ac7502-49ba-47a0-9ac9-e85e22fff0ce req-a065a496-c54d-4f43-89a9-3828391fdff1 tempest-TestStampPattern-1189422319 None] Deleting attachment 8bdf7ce1-421f-438d-81ff-35ba5dd69e34. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:31:07 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f 1073741824" returned: 0 in 0.913s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:08 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f
Jun 15 04:31:08 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:08 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.210s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1726189609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5756980-fddb-4de3-91c7-f28824c2b39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c0736aa7e4a338a4e23ac9e601992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:03Z,use_quota=True,user_id='54069a464a11479ebd3751e4df15ceb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Creating volume d5756980-fddb-4de3-91c7-f28824c2b39f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:08 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:08 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f 1073741824
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134fc4d0-3940-47c1-9370-2ba45e59f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:08 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de07a9d-a057-494a-b47c-a4b41f92f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Volume volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f (ef77719d-4d83-4a5d-babb-6ec9dd9a243f): created successfully
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de07a9d-a057-494a-b47c-a4b41f92f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (729d7524-9622-48f0-832b-93f3d4e7ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-486cb095-4cec-4236-9dd9-dc5924bdb433 tempest-CreateVolumesFromImageTest-928869044 None] Created volume successfully.
Jun 15 04:31:09 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f 1073741824" returned: 0 in 0.778s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:09 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f
Jun 15 04:31:09 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:10 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f" returned: 0 in 0.722s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ef1633-b894-405b-a9d5-8c7a1a8e468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5756980-fddb-4de3-91c7-f28824c2b39f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770eaf97-1034-4ca9-9522-3df49d5b46a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Creating offline snapshot bc560ba4-59b7-4f8e-b3b7-609e23224831 of volume b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:31:10 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Volume volume-d5756980-fddb-4de3-91c7-f28824c2b39f (d5756980-fddb-4de3-91c7-f28824c2b39f): created successfully
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770eaf97-1034-4ca9-9522-3df49d5b46a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Flow 'volume_create_manager' (52c0babf-2b12-40c8-ad8e-e72860b96ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c904594-8efd-44b0-b109-d07422429518]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:10 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fb293e76-7342-46ca-867c-6cb2f0270bcd tempest-CreateVolumesFromImageTest-928869044 None] Created volume successfully.
Jun 15 04:31:10 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:31:10 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:11 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.775s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:11 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 1G
Jun 15 04:31:11 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-d5756980-fddb-4de3-91c7-f28824c2b39f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-d5756980-fddb-4de3-91c7-f28824c2b39f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-quobyte-d5756980-fddb-4de3-91c7-f28824c2b39f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-d5756980-fddb-4de3-91c7-f28824c2b39f" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7e92bf-5158-4cab-bf89-7d9bfbe0f7e8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:11 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f
Jun 15 04:31:11 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:11 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 1G" returned: 0 in 0.950s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9567d68-1337-4110-b876-c7f0231cdf3e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:11 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9567d68-1337-4110-b876-c7f0231cdf3e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831
Jun 15 04:31:11 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:12 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f" returned: 0 in 0.785s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:12 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f
Jun 15 04:31:12 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:12 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9567d68-1337-4110-b876-c7f0231cdf3e -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831" returned: 0 in 0.666s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:12 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 is being set with open permissions: ugo+rw
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:12 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831
Jun 15 04:31:12 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:12 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d5756980-fddb-4de3-91c7-f28824c2b39f" returned: 0 in 0.674s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-d5756980-fddb-4de3-91c7-f28824c2b39f" released by "delete_volume" :: held 1.523s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Created reservations ['f99d21b3-a21b-49f5-b5fb-111541f64681', 'c41ced01-49e1-4969-b2bc-59ba497cd7ba', 'ee663fe1-7e74-4c0b-82aa-93c694228cbe', 'c24d238c-1f8e-4b97-ba75-b186d340fc61'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:13 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:13 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:13 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831" returned: 0 in 0.745s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:13 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info
Jun 15 04:31:13 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-ef77719d-4d83-4a5d-babb-6ec9dd9a243f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-ef77719d-4d83-4a5d-babb-6ec9dd9a243f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-quobyte-ef77719d-4d83-4a5d-babb-6ec9dd9a243f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-ef77719d-4d83-4a5d-babb-6ec9dd9a243f" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4dc4a7-e315-4e3e-a937-616ab690873e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:13 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.698s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Deleted volume successfully.
Jun 15 04:31:13 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f
Jun 15 04:31:13 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d8a84b4-34b8-4583-9ea5-83e2ae5dff77 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-d5756980-fddb-4de3-91c7-f28824c2b39f-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:14 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info" returned: 0 in 0.646s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:14 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info is being set with open permissions: ugo+rw
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:14 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info
Jun 15 04:31:14 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:14 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f" returned: 0 in 0.791s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:14 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f
Jun 15 04:31:14 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:14 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.info" returned: 0 in 0.615s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.515s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=120,cinder:SELECT=104,cinder:DELETE=10,cinder:INSERT=27 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:31:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8aa177c0-6194-4375-a791-2af5297164bf tempest-TestStampPattern-1189422319 None] Create snapshot completed successfully
Jun 15 04:31:14 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ef77719d-4d83-4a5d-babb-6ec9dd9a243f" returned: 0 in 0.599s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-ef77719d-4d83-4a5d-babb-6ec9dd9a243f" released by "delete_volume" :: held 1.431s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Created reservations ['ef4d615f-7fc4-4609-a499-a775c93112e4', 'c88e82f3-13cc-42ba-bd3a-3d0dc75b12f5', '78ab4192-825b-4545-a154-244454718b52', '2c12e87d-eb06-43c4-80ca-ed3fc50e7c82'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:15 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:15 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:15 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.605s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Deleted volume successfully.
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-c586e5e0-bdae-41eb-b8db-2ff0042aa701-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad56a0bc-895b-4a43-ad18-c4f96092c77d tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-ef77719d-4d83-4a5d-babb-6ec9dd9a243f-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-c586e5e0-bdae-41eb-b8db-2ff0042aa701-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-quobyte-c586e5e0-bdae-41eb-b8db-2ff0042aa701" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-c586e5e0-bdae-41eb-b8db-2ff0042aa701" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f227ae9-a0e0-4834-ae7e-3bec605751c5]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:15 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701
Jun 15 04:31:15 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:16 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701" returned: 0 in 0.724s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:16 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701
Jun 15 04:31:16 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:17 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c586e5e0-bdae-41eb-b8db-2ff0042aa701" returned: 0 in 0.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-c586e5e0-bdae-41eb-b8db-2ff0042aa701" released by "delete_volume" :: held 1.383s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Created reservations ['9780f475-9c81-42fd-bd0f-152eb2b99e18', '4c9fdfca-858d-4447-844a-b63c994088b4', '0112cf1d-ac2d-4ffe-80a7-ede24c0a9696', 'f21ee2c6-53d5-4f41-8e98-b40f7a37fa97'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:17 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:17 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:17 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.642s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Deleted volume successfully.
Jun 15 04:31:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-99677eb2-9cf0-484a-b533-68ee3e6ca01a-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-b01aa20d-ad10-485a-80f8-335ec8a18bb0 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-c586e5e0-bdae-41eb-b8db-2ff0042aa701-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-99677eb2-9cf0-484a-b533-68ee3e6ca01a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-quobyte-99677eb2-9cf0-484a-b533-68ee3e6ca01a" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-99677eb2-9cf0-484a-b533-68ee3e6ca01a" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6f658-44c3-4a01-8140-fa7d6cc86802]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:18 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a
Jun 15 04:31:18 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "cinder-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "cinder-quobyte-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-quobyte-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aaf3a2-0c35-4591-bd2f-e2a3b7a39e34]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:18 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca
Jun 15 04:31:18 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:18 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a" returned: 0 in 0.770s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:18 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a
Jun 15 04:31:18 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:19 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" returned: 0 in 0.741s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:19 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca
Jun 15 04:31:19 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:19 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-99677eb2-9cf0-484a-b533-68ee3e6ca01a" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-99677eb2-9cf0-484a-b533-68ee3e6ca01a" released by "delete_volume" :: held 1.428s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Created reservations ['e6f10fa8-8150-4183-b416-e8ba3aa82850', '180d11a3-6d03-4b27-91c5-6f75be903602', 'edbdbe63-b80a-46bd-a1f6-398b55fd37bc', '8814b38d-ce3c-4f1f-b613-c8a8b1e51dad'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:19 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:19 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:19 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" returned: 0 in 0.629s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-quobyte-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca" released by "delete_volume" :: held 1.425s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Created reservations ['ea5cefb7-671a-45e6-a839-b82c2537a4fa', '599ea0e9-0f15-4170-98a7-95bc49980dc0', 'e1b32fee-b24c-43a2-a316-fc2519521830', 'fc0245d2-ef32-48a5-a239-20b8f5b1cbd3'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:20 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:20 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "cinder-quobyte-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:20 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.694s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Deleted volume successfully.
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab27329-aac2-4909-8f97-e50628e882ba]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-877608f7-9880-4d34-80f3-05524e853e4e tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-99677eb2-9cf0-484a-b533-68ee3e6ca01a-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:20 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145
Jun 15 04:31:20 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "cinder-b1972f04-b43e-49a3-94c0-5e0bd130f1f4-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:20 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.745s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-b1972f04-b43e-49a3-94c0-5e0bd130f1f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Deleted volume successfully.
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-628e0469-7008-4153-bd80-462a2a2866ca tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-2b7b0939-acd7-4dd3-b9d1-4a44a1a4aeca-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "cinder-quobyte-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-quobyte-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d779c31-ee8a-4cd7-b7f9-c52c99772cf2]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:21 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4
Jun 15 04:31:21 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:21 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145" returned: 0 in 0.804s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:21 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145
Jun 15 04:31:21 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:21 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" returned: 0 in 0.732s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:21 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4
Jun 15 04:31:21 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:21 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145" returned: 0 in 0.636s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-quobyte-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145" released by "delete_volume" :: held 1.484s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Created reservations ['2e08f210-ca6d-4ee8-8b4f-6fbce4163041', '019ab567-fe2f-4c29-b9c5-d7edebee26d1', 'edc76ddd-bd26-493a-8e92-1cc2c70cc6ce', '4905c692-6d67-48ca-9f06-40d8c17219c3'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:22 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:22 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:22 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" returned: 0 in 0.627s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-quobyte-b1972f04-b43e-49a3-94c0-5e0bd130f1f4" released by "delete_volume" :: held 1.404s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Created reservations ['d5f72c13-852e-48dd-9963-a7845498984a', '3cc43522-b2f4-40aa-9cab-a46106539b33', '375bb211-b92c-48a6-9621-9f253b3f5587', '5a22ca4d-6b40-4982-a7ba-7799ff98c0ce'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:22 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:22 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:22 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:22 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Deleted volume successfully.
Jun 15 04:31:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a6972ea-07ea-44eb-b4e4-2910c9129c08 tempest-CreateVolumesFromImageTest-928869044 None] Lock "cinder-fd71c7a9-ea00-4cbb-8f26-b99d7e7bb145-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:23 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.674s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Deleted volume successfully.
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=121,cinder:UPDATE=163,cinder:DELETE=18,cinder:INSERT=47 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-75cf8e4e-4407-459e-b1d5-0691e3a5658e tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-b1972f04-b43e-49a3-94c0-5e0bd130f1f4-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "cinder-5ee704df-583b-48e8-8150-c5c7ef84483d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-5ee704df-583b-48e8-8150-c5c7ef84483d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "cinder-quobyte-5ee704df-583b-48e8-8150-c5c7ef84483d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-quobyte-5ee704df-583b-48e8-8150-c5c7ef84483d" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[38993e6d-1768-4d94-8a2b-d329b7032b2d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:23 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d
Jun 15 04:31:23 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:24 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d" returned: 0 in 0.834s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:24 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d
Jun 15 04:31:24 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:25 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5ee704df-583b-48e8-8150-c5c7ef84483d" returned: 0 in 0.652s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-quobyte-5ee704df-583b-48e8-8150-c5c7ef84483d" released by "delete_volume" :: held 1.547s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Created reservations ['340b9ac1-ca22-4608-85c0-c4f3d8b604bd', '2b07047a-f22b-4059-af0a-534f655c902b', 'c38849ff-2691-433e-b49b-e8ed7358c091', '1fe3d722-0126-4f60-b188-04cb31aa47be'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:25 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:25 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Flow 'volume_create_manager' (8aec254e-2e15-447a-b7fd-1ac9f4db0117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebaa676-d649-4f7c-b745-c31705632fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebaa676-d649-4f7c-b745-c31705632fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2020913822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c053053-e3e5-47a1-8863-81766530140b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a3efd4de7d48378cf1fe941a2ace88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc560ba4-59b7-4f8e-b3b7-609e23224831,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:25Z,use_quota=True,user_id='985bee5edd6c4aa88b6d91f7f6d5ff8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1186ff9a-6ec9-47eb-9493-7990b209da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1186ff9a-6ec9-47eb-9493-7990b209da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708b444b-123f-4d16-813a-51b10c40fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708b444b-123f-4d16-813a-51b10c40fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c053053-e3e5-47a1-8863-81766530140b', 'volume_name': 'volume-5c053053-e3e5-47a1-8863-81766530140b', 'volume_size': 1, 'snapshot_id': 'bc560ba4-59b7-4f8e-b3b7-609e23224831'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07597ef6-fa60-478f-a85a-32d7fd2269fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07597ef6-fa60-478f-a85a-32d7fd2269fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b794fa-9fe9-4af5-8656-5949abf715f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:25 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Volume 5c053053-e3e5-47a1-8863-81766530140b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c053053-e3e5-47a1-8863-81766530140b', 'volume_size': 1, 'snapshot_id': 'bc560ba4-59b7-4f8e-b3b7-609e23224831'}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-quobyte-bc560ba4-59b7-4f8e-b3b7-609e23224831-5c053053-e3e5-47a1-8863-81766530140b" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-bc560ba4-59b7-4f8e-b3b7-609e23224831-5c053053-e3e5-47a1-8863-81766530140b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Creating volume 5c053053-e3e5-47a1-8863-81766530140b from snapshot bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-quobyte-5c053053-e3e5-47a1-8863-81766530140b" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-5c053053-e3e5-47a1-8863-81766530140b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] snapshot: bc560ba4-59b7-4f8e-b3b7-609e23224831, volume: 5c053053-e3e5-47a1-8863-81766530140b,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b963d-9acf-454d-9bc0-211e926fbba9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:25 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831
Jun 15 04:31:25 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:25 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.758s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:25 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Deleted volume successfully.
Jun 15 04:31:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-175e01b6-d8d8-4440-ac9c-b4f06eee5376 tempest-AttachVolumeNegativeTest-393846504 None] Lock "cinder-5ee704df-583b-48e8-8150-c5c7ef84483d-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:26 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831" returned: 0 in 1.010s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9567d68-1337-4110-b876-c7f0231cdf3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:31:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:31:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:31:26 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[232870a1-4f19-41cc-945d-b1dc66aa001b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:26 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:31:26 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:27 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.961s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:27 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:31:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:27 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b
Jun 15 04:31:27 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Flow 'volume_create_manager' (a091b22c-6056-493a-b742-1e858a96dd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c468fb7a-9cb3-4e3f-8f2f-76e949e5e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c468fb7a-9cb3-4e3f-8f2f-76e949e5e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5c907f-a830-4117-bbc2-fc549fd417c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8353bd16433c4e0588d70f6a3ad2bec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:29Z,use_quota=True,user_id='6b743c40233e4d43981049f6bc6e9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36edf77-e3a5-4459-ada0-2c85d32e6bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36edf77-e3a5-4459-ada0-2c85d32e6bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6beed54c-586b-431e-b020-a60ad7c341cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:29 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6beed54c-586b-431e-b020-a60ad7c341cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a5c907f-a830-4117-bbc2-fc549fd417c0', 'volume_name': 'volume-7a5c907f-a830-4117-bbc2-fc549fd417c0', 'volume_size': 1, 'image_id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0deb2d7ec1a8fe34d80f7b9b7842f73', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8353bd16433c4e0588d70f6a3ad2bec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '654303aa5af245df727af2408f057ae02a610f06311e8749baaaf651e972872892bdb27a84a45fd9914640f06bd7119ada01b4fae5dcb24ea4a3aef26e66a9d9', 'id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'created_at': datetime.datetime(2026, 6, 15, 2, 31, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 31, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c393a6f0>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbadb30-1dea-4cfc-8796-13b336adf32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbadb30-1dea-4cfc-8796-13b336adf32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f706803e-a7a3-4b03-bfa2-90fa9e5c5f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Volume 7a5c907f-a830-4117-bbc2-fc549fd417c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a5c907f-a830-4117-bbc2-fc549fd417c0', 'volume_size': 1, 'image_id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0deb2d7ec1a8fe34d80f7b9b7842f73', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8353bd16433c4e0588d70f6a3ad2bec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '654303aa5af245df727af2408f057ae02a610f06311e8749baaaf651e972872892bdb27a84a45fd9914640f06bd7119ada01b4fae5dcb24ea4a3aef26e66a9d9', 'id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'created_at': datetime.datetime(2026, 6, 15, 2, 31, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 31, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c393a6f0>}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Trying to clone 7a5c907f-a830-4117-bbc2-fc549fd417c0 from image 4c5e7716-f003-4b4f-8e6f-607b9af4998e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:31:30 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1544fb-ce9e-4163-9511-7c14bc5bdef6]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:30 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD
Jun 15 04:31:30 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:31 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD" returned: 0 in 1.174s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:31 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD
Jun 15 04:31:31 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:33 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD" returned: 1 in 2.058s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:31:33 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Temporary image 4c5e7716-f003-4b4f-8e6f-607b9af4998e is fetched for user 6b743c40233e4d43981049f6bc6e9f79. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:31:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae929e41-5c4f-485f-8aa5-8a0f678f718b]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:34 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD
Jun 15 04:31:34 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:34 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b" returned: 0 in 7.467s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b4b747-f158-4019-ad25-d1d526139a92]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:35 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:31:35 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:35 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:35 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:35 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD" returned: 0 in 1.663s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:35 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD
Jun 15 04:31:35 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:36 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD" returned: 1 in 0.944s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:36 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.178s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:31:36 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 1.668s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:31:36 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Converted 1024.00 MB image at 136.97 MB/s
Jun 15 04:31:36 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b is being set with open permissions: ugo+rw
Jun 15 04:31:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:36 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b
Jun 15 04:31:36 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:37 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b" returned: 0 in 0.766s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-5c053053-e3e5-47a1-8863-81766530140b" released by "_copy_volume_from_snapshot" :: held 12.016s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-bc560ba4-59b7-4f8e-b3b7-609e23224831-5c053053-e3e5-47a1-8863-81766530140b" released by "_create_volume_from_snapshot" :: held 12.051s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.074s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5c907f-a830-4117-bbc2-fc549fd417c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8353bd16433c4e0588d70f6a3ad2bec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:29Z,use_quota=True,user_id='6b743c40233e4d43981049f6bc6e9f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Creating volume 7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:37 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:37 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 1073741824
Jun 15 04:31:37 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b794fa-9fe9-4af5-8656-5949abf715f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c053053-e3e5-47a1-8863-81766530140b', 'volume_size': 1, 'snapshot_id': 'bc560ba4-59b7-4f8e-b3b7-609e23224831'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c133417d-c3da-4203-bbc7-951df87164d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Volume volume-5c053053-e3e5-47a1-8863-81766530140b (5c053053-e3e5-47a1-8863-81766530140b): created successfully
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c133417d-c3da-4203-bbc7-951df87164d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Flow 'volume_create_manager' (8aec254e-2e15-447a-b7fd-1ac9f4db0117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1479213a-9d78-40ca-8efc-c993f7938a82 tempest-TestStampPattern-1189422319 None] Created volume successfully.
Jun 15 04:31:38 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 1073741824" returned: 0 in 0.889s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:38 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:38 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:39 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 0 in 0.610s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Attempting download of 4c5e7716-f003-4b4f-8e6f-607b9af4998e ((None, [{'url': 'file:///opt/stack/data/glance/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'metadata': {}}])) to volume 7a5c907f-a830-4117-bbc2-fc549fd417c0. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d6f28c-59d2-4eaa-b4a4-c7878a7029d4]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:39 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h
Jun 15 04:31:39 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:39 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:39 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h
Jun 15 04:31:39 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:40 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h" returned: 1 in 0.699s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c5e7716-f003-4b4f-8e6f-607b9af4998e_nsvc9j0h' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:31:40 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37e95f-550b-4efa-8179-e369610b012f]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:40 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD
Jun 15 04:31:40 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:41 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:41 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD
Jun 15 04:31:41 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:42 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:31:42 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] 4c5e7716-f003-4b4f-8e6f-607b9af4998e was raw, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:31:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:42 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:42 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:43 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 0 in 1.026s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:43 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c5e7716-f003-4b4f-8e6f-607b9af4998e_qw9wiujjdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:31:43 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 04:31:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:43 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 1G
Jun 15 04:31:43 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:44 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 1G" returned: 0 in 0.900s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7f5b96-3724-4f7d-834b-f64dd59f5141]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:44 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:44 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9832d088-aeda-427b-bbac-1f6481fba87c tempest-GroupsTest-2084669540 None] Group tempest-Group1-2076206829: creating
Jun 15 04:31:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9832d088-aeda-427b-bbac-1f6481fba87c tempest-GroupsTest-2084669540 None] Group tempest-Group1-2076206829: created successfully
Jun 15 04:31:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9832d088-aeda-427b-bbac-1f6481fba87c tempest-GroupsTest-2084669540 None] Create group completed successfully.
Jun 15 04:31:44 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 0 in 0.899s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:45 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:45 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b437b9be-483c-4b92-9dc4-0d240df0207e tempest-GroupsTest-2084669540 None] Group tempest-Group2-176821363: creating
Jun 15 04:31:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b437b9be-483c-4b92-9dc4-0d240df0207e tempest-GroupsTest-2084669540 None] Group tempest-Group2-176821363: created successfully
Jun 15 04:31:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b437b9be-483c-4b92-9dc4-0d240df0207e tempest-GroupsTest-2084669540 None] Create group completed successfully.
Jun 15 04:31:45 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 1 in 0.955s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Downloaded image 4c5e7716-f003-4b4f-8e6f-607b9af4998e ((None, [{'url': 'file:///opt/stack/data/glance/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'metadata': {}}])) to volume 7a5c907f-a830-4117-bbc2-fc549fd417c0 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Temporary image 4c5e7716-f003-4b4f-8e6f-607b9af4998e for user 6b743c40233e4d43981049f6bc6e9f79 is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Marking volume 7a5c907f-a830-4117-bbc2-fc549fd417c0 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Copying metadata from image 4c5e7716-f003-4b4f-8e6f-607b9af4998e to 7a5c907f-a830-4117-bbc2-fc549fd417c0. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:31:45 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Creating volume glance metadata for volume 7a5c907f-a830-4117-bbc2-fc549fd417c0 backed by image 4c5e7716-f003-4b4f-8e6f-607b9af4998e with: {'image_id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e0deb2d7ec1a8fe34d80f7b9b7842f73', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:31:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f706803e-a7a3-4b03-bfa2-90fa9e5c5f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5c907f-a830-4117-bbc2-fc549fd417c0', 'volume_size': 1, 'image_id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0deb2d7ec1a8fe34d80f7b9b7842f73', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8353bd16433c4e0588d70f6a3ad2bec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '654303aa5af245df727af2408f057ae02a610f06311e8749baaaf651e972872892bdb27a84a45fd9914640f06bd7119ada01b4fae5dcb24ea4a3aef26e66a9d9', 'id': '4c5e7716-f003-4b4f-8e6f-607b9af4998e', 'created_at': datetime.datetime(2026, 6, 15, 2, 31, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 31, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c5e7716-f003-4b4f-8e6f-607b9af4998e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c393a6f0>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767cebd5-6a70-49ec-bd41-0490d8a9b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:46 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Volume volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 (7a5c907f-a830-4117-bbc2-fc549fd417c0): created successfully
Jun 15 04:31:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767cebd5-6a70-49ec-bd41-0490d8a9b624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Flow 'volume_create_manager' (a091b22c-6056-493a-b742-1e858a96dd70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4a2200e5-c827-4c09-ae84-8bf1de3c3ba9 tempest-VolumeImageDependencyTests-582206247 None] Created volume successfully.
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Acquiring lock "cinder-7a5c907f-a830-4117-bbc2-fc549fd417c0-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Lock "cinder-7a5c907f-a830-4117-bbc2-fc549fd417c0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Acquiring lock "cinder-quobyte-7a5c907f-a830-4117-bbc2-fc549fd417c0" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Lock "cinder-quobyte-7a5c907f-a830-4117-bbc2-fc549fd417c0" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd8782-a7b5-4a2e-b8b1-24939d7b208a]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Flow 'volume_create_manager' (7326b55a-dff3-411d-98c0-28b26b9fb5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05226552-f6d2-47cf-b2cc-33f4e66ba332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05226552-f6d2-47cf-b2cc-33f4e66ba332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106047611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15a81eb2-0145-4655-a401-dcf41a5a5c4d,host='devstack@QuobyteHD#QuobyteHD',id=d56713db-da9c-4f39-9dfc-536ebbd679ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0be164a59472096379668af345357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:47Z,use_quota=True,user_id='3e7c4940ca2640e4bf3557422ba8f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(074a0f93-3524-46c6-a788-c5159f7ef040),volume_type_id=074a0f93-3524-46c6-a788-c5159f7ef040)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf13197e-3383-4ee6-9bdd-af548fdb25f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf13197e-3383-4ee6-9bdd-af548fdb25f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:47 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:47 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f07303-d90c-4712-85a7-8d674ed8d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f07303-d90c-4712-85a7-8d674ed8d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56713db-da9c-4f39-9dfc-536ebbd679ff', 'volume_name': 'volume-d56713db-da9c-4f39-9dfc-536ebbd679ff', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff46615-012d-4828-9bfe-45e981e3dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff46615-012d-4828-9bfe-45e981e3dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e193f3aa-850f-4c6c-b8cd-49e204cb0703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:47 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Volume d56713db-da9c-4f39-9dfc-536ebbd679ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56713db-da9c-4f39-9dfc-536ebbd679ff', 'volume_size': 1}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15a81eb2-0145-4655-a401-dcf41a5a5c4d,created_at=2026-06-15T02:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1106047611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15a81eb2-0145-4655-a401-dcf41a5a5c4d,host='devstack@QuobyteHD#QuobyteHD',id=d56713db-da9c-4f39-9dfc-536ebbd679ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0be164a59472096379668af345357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:47Z,use_quota=True,user_id='3e7c4940ca2640e4bf3557422ba8f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(074a0f93-3524-46c6-a788-c5159f7ef040),volume_type_id=074a0f93-3524-46c6-a788-c5159f7ef040)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Creating volume d56713db-da9c-4f39-9dfc-536ebbd679ff {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:47 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:47 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff 1073741824
Jun 15 04:31:47 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:48 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 0 in 0.804s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:48 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:48 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:48 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff 1073741824" returned: 0 in 0.933s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:48 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff
Jun 15 04:31:48 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:48 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 1 in 0.814s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:31:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:48 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0
Jun 15 04:31:48 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:49 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e193f3aa-850f-4c6c-b8cd-49e204cb0703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56713db-da9c-4f39-9dfc-536ebbd679ff', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a592fa-827c-4c01-a9ef-ef81e80fdb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:49 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Volume volume-d56713db-da9c-4f39-9dfc-536ebbd679ff (d56713db-da9c-4f39-9dfc-536ebbd679ff): created successfully
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a592fa-827c-4c01-a9ef-ef81e80fdb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Flow 'volume_create_manager' (7326b55a-dff3-411d-98c0-28b26b9fb5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5569645d-8093-49ed-82cf-d0d604df19b2 tempest-GroupsTest-2084669540 None] Created volume successfully.
Jun 15 04:31:49 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-7a5c907f-a830-4117-bbc2-fc549fd417c0" returned: 0 in 0.662s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Lock "cinder-quobyte-7a5c907f-a830-4117-bbc2-fc549fd417c0" released by "delete_volume" :: held 2.408s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Created reservations ['7edf4403-3a3a-4e74-a595-d55152ec9ccb', 'b4e0e6c1-bce7-4919-9ac5-3a2f9e44427d', 'e5797bb4-f3ad-478a-9708-59fba72ca81e', '8f3a28c5-e4da-439a-b9a4-c2a0e884ab81'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:49 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:49 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Acquiring lock "cinder-quobyte-d56713db-da9c-4f39-9dfc-536ebbd679ff" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Lock "cinder-quobyte-d56713db-da9c-4f39-9dfc-536ebbd679ff" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77da49-b041-41ad-a691-8a22555c656a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:50 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff
Jun 15 04:31:50 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:50 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.683s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:50 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Deleted volume successfully.
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-7a6725f6-caa8-4701-a73f-98a9c5fbf16d tempest-VolumeImageDependencyTests-582206247 None] Lock "cinder-7a5c907f-a830-4117-bbc2-fc549fd417c0-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:50 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff" returned: 0 in 0.796s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:50 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff
Jun 15 04:31:50 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:51 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d56713db-da9c-4f39-9dfc-536ebbd679ff" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Lock "cinder-quobyte-d56713db-da9c-4f39-9dfc-536ebbd679ff" released by "delete_volume" :: held 1.554s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Created reservations ['ba3da724-f91e-496b-a4af-fb4dc22334e4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:51 devstack cinder-volume[92103]: WARNING cinder.quota [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-169477090 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-169477090, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:31:51 devstack cinder-volume[92103]: WARNING cinder.quota [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-169477090 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-169477090, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Created reservations ['561365d0-21f0-4bc4-8679-e58d1b20cab0', 'aaa43693-cdc6-44bd-9516-2518ae630398', 'e7a43ef3-3e11-4fc8-8ff9-76db07f5ceba', '68dbadaf-bc1d-4a09-8041-e03ef222b9bd'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:51 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:51 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Created reservations ['2bcb7a2c-2abc-436e-bdc2-9d7edc639e19'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:31:52 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.695s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c703f61d-f3c8-41d2-8d0d-c9daf6edee54 tempest-GroupsTest-2084669540 None] Delete group completed successfully.
Jun 15 04:31:52 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:31:52 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:53 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.636s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:53 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:31:53 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-f757245e-681e-41a6-8188-b18c503c4e9e tempest-GroupsTest-2084669540 None] Delete group completed successfully.
Jun 15 04:31:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fc5f92b9-41b5-43f0-93a2-c7900e86c861 tempest-GroupsTest-2084669540 None] Group tempest-GroupsTest-Group-508674416: creating
Jun 15 04:31:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fc5f92b9-41b5-43f0-93a2-c7900e86c861 tempest-GroupsTest-2084669540 None] Group tempest-GroupsTest-Group-508674416: created successfully
Jun 15 04:31:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fc5f92b9-41b5-43f0-93a2-c7900e86c861 tempest-GroupsTest-2084669540 None] Create group completed successfully.
Jun 15 04:31:55 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Flow 'volume_create_manager' (88546208-1bba-410c-bcdf-f5a6f8603849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f99d5ef-7f4c-4d9a-9a14-a543d180b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f99d5ef-7f4c-4d9a-9a14-a543d180b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488431134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a1400d8-bc32-4b9a-9371-46665855058a,host='devstack@QuobyteHD#QuobyteHD',id=be1ee693-9126-4ca6-8ab7-6845ed20541f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0be164a59472096379668af345357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:56Z,use_quota=True,user_id='3e7c4940ca2640e4bf3557422ba8f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0992bf1-b579-40ab-87c5-86cba14cc977),volume_type_id=a0992bf1-b579-40ab-87c5-86cba14cc977)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bfb27d-d1fd-4928-93c0-b919f5d42f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bfb27d-d1fd-4928-93c0-b919f5d42f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb30cda-003e-4646-b32a-eb046b180889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb30cda-003e-4646-b32a-eb046b180889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1ee693-9126-4ca6-8ab7-6845ed20541f', 'volume_name': 'volume-be1ee693-9126-4ca6-8ab7-6845ed20541f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e8cda2-76f4-4d99-a88d-726a3a168824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e8cda2-76f4-4d99-a88d-726a3a168824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6da1ee9-e0b6-422b-93f8-c98a2fddf73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:56 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Volume be1ee693-9126-4ca6-8ab7-6845ed20541f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1ee693-9126-4ca6-8ab7-6845ed20541f', 'volume_size': 1}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0a1400d8-bc32-4b9a-9371-46665855058a,created_at=2026-06-15T02:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488431134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a1400d8-bc32-4b9a-9371-46665855058a,host='devstack@QuobyteHD#QuobyteHD',id=be1ee693-9126-4ca6-8ab7-6845ed20541f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0be164a59472096379668af345357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:56Z,use_quota=True,user_id='3e7c4940ca2640e4bf3557422ba8f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0992bf1-b579-40ab-87c5-86cba14cc977),volume_type_id=a0992bf1-b579-40ab-87c5-86cba14cc977)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Creating volume be1ee693-9126-4ca6-8ab7-6845ed20541f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:56 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:56 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f 1073741824
Jun 15 04:31:56 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:56 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f 1073741824" returned: 0 in 0.840s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:56 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f
Jun 15 04:31:56 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:57 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f" returned: 0 in 0.624s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6da1ee9-e0b6-422b-93f8-c98a2fddf73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1ee693-9126-4ca6-8ab7-6845ed20541f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52af3f39-8865-476d-bcaa-a0ffbd9f3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Volume volume-be1ee693-9126-4ca6-8ab7-6845ed20541f (be1ee693-9126-4ca6-8ab7-6845ed20541f): created successfully
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52af3f39-8865-476d-bcaa-a0ffbd9f3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Flow 'volume_create_manager' (88546208-1bba-410c-bcdf-f5a6f8603849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-02533e1a-b594-484f-a29b-b99bdb036f2a tempest-GroupsTest-2084669540 None] Created volume successfully.
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Flow 'volume_create_manager' (db83ce66-d949-438f-8ec4-16de7380b9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed14927-e8de-4f36-a252-b8cbeabbcff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed14927-e8de-4f36-a252-b8cbeabbcff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1272671883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a1400d8-bc32-4b9a-9371-46665855058a,host='devstack@QuobyteHD#QuobyteHD',id=9c6d1732-e32b-44ee-87c5-460c9d2c7386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0be164a59472096379668af345357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:59Z,use_quota=True,user_id='3e7c4940ca2640e4bf3557422ba8f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0992bf1-b579-40ab-87c5-86cba14cc977),volume_type_id=a0992bf1-b579-40ab-87c5-86cba14cc977)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec4c970-238e-4dfc-9ab8-66799baa14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec4c970-238e-4dfc-9ab8-66799baa14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fa7a6d-db9f-4f69-8252-496105a60909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fa7a6d-db9f-4f69-8252-496105a60909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6d1732-e32b-44ee-87c5-460c9d2c7386', 'volume_name': 'volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0335e287-1a23-473b-b2ff-596e0d41100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0335e287-1a23-473b-b2ff-596e0d41100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d652975-04b8-4803-84d9-a39075fa4f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:31:58 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Volume 9c6d1732-e32b-44ee-87c5-460c9d2c7386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386', 'volume_size': 1}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0a1400d8-bc32-4b9a-9371-46665855058a,created_at=2026-06-15T02:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1272671883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0a1400d8-bc32-4b9a-9371-46665855058a,host='devstack@QuobyteHD#QuobyteHD',id=9c6d1732-e32b-44ee-87c5-460c9d2c7386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c0be164a59472096379668af345357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:31:59Z,use_quota=True,user_id='3e7c4940ca2640e4bf3557422ba8f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0992bf1-b579-40ab-87c5-86cba14cc977),volume_type_id=a0992bf1-b579-40ab-87c5-86cba14cc977)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Creating volume 9c6d1732-e32b-44ee-87c5-460c9d2c7386 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:31:58 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:31:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:58 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 1073741824
Jun 15 04:31:58 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:31:59 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Jun 15 04:31:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 1073741824" returned: 0 in 0.991s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:31:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:31:59 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386
Jun 15 04:31:59 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:00 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386" returned: 0 in 0.646s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d652975-04b8-4803-84d9-a39075fa4f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4197be4f-0d57-48ce-ac2e-71d6bc278cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Volume volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 (9c6d1732-e32b-44ee-87c5-460c9d2c7386): created successfully
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4197be4f-0d57-48ce-ac2e-71d6bc278cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Flow 'volume_create_manager' (db83ce66-d949-438f-8ec4-16de7380b9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-86ffa74b-cd77-4330-8e6f-e42cd1a23dd6 tempest-GroupsTest-2084669540 None] Created volume successfully.
Jun 15 04:32:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a1953391-b8a9-4d70-a8de-c8e92232de88 tempest-GroupsTest-2084669540 None] Update group completed successfully.
Jun 15 04:32:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-36cc8a0e-b664-4275-a9b4-44f78faac98a tempest-GroupsTest-2084669540 None] Update group completed successfully.
Jun 15 04:32:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Acquiring lock "cinder-quobyte-9c6d1732-e32b-44ee-87c5-460c9d2c7386" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:03 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Lock "cinder-quobyte-9c6d1732-e32b-44ee-87c5-460c9d2c7386" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7e24af-333d-4c7e-99ce-f00d73a00f66]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:04 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386
Jun 15 04:32:04 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:04 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:04 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386
Jun 15 04:32:04 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:05 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9c6d1732-e32b-44ee-87c5-460c9d2c7386" returned: 0 in 0.599s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Lock "cinder-quobyte-9c6d1732-e32b-44ee-87c5-460c9d2c7386" released by "delete_volume" :: held 1.348s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Acquiring lock "cinder-quobyte-be1ee693-9126-4ca6-8ab7-6845ed20541f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Lock "cinder-quobyte-be1ee693-9126-4ca6-8ab7-6845ed20541f" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:05 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef63d7f-9acf-4147-882b-c47e37dcba34]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:05 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f
Jun 15 04:32:05 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:06 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f" returned: 0 in 0.703s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:06 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f
Jun 15 04:32:06 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:06 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-be1ee693-9126-4ca6-8ab7-6845ed20541f" returned: 0 in 0.675s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Lock "cinder-quobyte-be1ee693-9126-4ca6-8ab7-6845ed20541f" released by "delete_volume" :: held 1.422s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:06 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Created reservations ['a4e70d15-53cc-48c1-8059-373d6ce8cfff'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:06 devstack cinder-volume[92103]: WARNING cinder.quota [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-664481646 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-664481646, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:32:06 devstack cinder-volume[92103]: WARNING cinder.quota [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-664481646 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-664481646, it is now deprecated. Please use the default quota class for default quota.
Jun 15 04:32:06 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Created reservations ['8436d205-953e-4882-9cec-12b417c545a5', 'f9d11c94-e9bc-43ea-bf29-fa47ad6a588d', '3f6a9c70-f267-4e87-92e5-28ae33b356bb', 'aa20fd70-6271-4c81-abd7-f5228a9ef7e9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Created reservations ['9c3dbd6a-b60c-4352-afd9-3a528d51f6c5', '4fd686d4-ec1c-4806-8520-43ebf2fbdd5a', 'b6815998-8175-43e7-a459-31ecbfc9ec3a', '80242ceb-2572-4d52-ae67-191f597aadf8'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:07 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:07 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:07 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.823s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:07 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0feaee42-ad54-459e-b321-60d7a4cf2c20 tempest-GroupsTest-2084669540 None] Delete group completed successfully.
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Flow 'volume_create_manager' (18e4ddfb-f265-42c0-abc5-53fc6767ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76cce6b-713f-427a-bc98-627241db153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76cce6b-713f-427a-bc98-627241db153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-38195024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb29422-58bd-45b0-a68e-c456e9c5d6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17466e22b674a82877637d480c23380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:12Z,use_quota=True,user_id='12120eff37864a96b64da54d4c9fea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f575aa-8142-4d2a-8b9a-cde650537948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f575aa-8142-4d2a-8b9a-cde650537948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b467137-e0c0-45d0-8be9-b1ed365414c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b467137-e0c0-45d0-8be9-b1ed365414c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb29422-58bd-45b0-a68e-c456e9c5d6a3', 'volume_name': 'volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069ad763-1d74-4226-9b83-3c8afe34bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069ad763-1d74-4226-9b83-3c8afe34bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1d368d-94b0-4242-b19f-6a74f0615e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:12 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Volume 3eb29422-58bd-45b0-a68e-c456e9c5d6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3', 'volume_size': 1}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-38195024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb29422-58bd-45b0-a68e-c456e9c5d6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17466e22b674a82877637d480c23380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:12Z,use_quota=True,user_id='12120eff37864a96b64da54d4c9fea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Creating volume 3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:32:12 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:32:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:12 devstack sudo[107598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 1073741824
Jun 15 04:32:12 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:13 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 1073741824" returned: 0 in 0.798s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:13 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:13 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-78d0473d-97bd-4f89-a746-668cf1a05483 tempest-GroupsV320Test-1568148598 None] Group tempest-GroupsV320Test-Group-1722941895: creating
Jun 15 04:32:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-78d0473d-97bd-4f89-a746-668cf1a05483 tempest-GroupsV320Test-1568148598 None] Group tempest-GroupsV320Test-Group-1722941895: created successfully
Jun 15 04:32:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-78d0473d-97bd-4f89-a746-668cf1a05483 tempest-GroupsV320Test-1568148598 None] Create group completed successfully.
Jun 15 04:32:13 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:32:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1d368d-94b0-4242-b19f-6a74f0615e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc7ad83-37d6-4653-bec4-80a1a896fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:14 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Volume volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 (3eb29422-58bd-45b0-a68e-c456e9c5d6a3): created successfully
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc7ad83-37d6-4653-bec4-80a1a896fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Flow 'volume_create_manager' (18e4ddfb-f265-42c0-abc5-53fc6767ff45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4f37ce64-87f1-4b41-be0b-bc9174cdcfcc tempest-SnapshotDependencyTests-477290925 None] Created volume successfully.
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=98,cinder:INSERT=25,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Creating offline snapshot 3773afea-1042-4bcf-a8f5-6ec60dd9eac0 of volume 3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[60645d05-2c17-421b-8ce4-4f5700881542]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:14 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:14 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Created reservations ['5f304bfc-285f-47d7-bc75-cf8f4ce984da'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:15 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.744s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:15 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 1G
Jun 15 04:32:15 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:15 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:15 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:16 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.619s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:16 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9fe969c5-dcb3-40a3-b21a-66bc53e242e3 tempest-GroupsV320Test-1568148598 None] Delete group completed successfully.
Jun 15 04:32:16 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 1G" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:16 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0
Jun 15 04:32:16 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:17 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0" returned: 0 in 0.666s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:17 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 is being set with open permissions: ugo+rw
Jun 15 04:32:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:17 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0
Jun 15 04:32:17 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:17 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:17 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info
Jun 15 04:32:17 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:18 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info" returned: 0 in 0.659s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:18 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info is being set with open permissions: ugo+rw
Jun 15 04:32:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:18 devstack sudo[107631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info
Jun 15 04:32:18 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:18 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.info" returned: 0 in 0.619s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.221s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-566af714-9839-486b-a828-0c59032536e8 tempest-SnapshotDependencyTests-477290925 None] Create snapshot completed successfully
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Flow 'volume_create_manager' (4b3f9c13-15ce-440c-8ea9-8bd5ad6531a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c32b907-778c-4384-a76e-d4d23bf2bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c32b907-778c-4384-a76e-d4d23bf2bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3684caea-1d96-47cf-b1f1-1bdb27a42416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17466e22b674a82877637d480c23380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3773afea-1042-4bcf-a8f5-6ec60dd9eac0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:20Z,use_quota=True,user_id='12120eff37864a96b64da54d4c9fea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6128886-5309-49cb-8a0a-a8a77323c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6128886-5309-49cb-8a0a-a8a77323c214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95b58d-cb77-40da-a33b-917b75375885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95b58d-cb77-40da-a33b-917b75375885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3684caea-1d96-47cf-b1f1-1bdb27a42416', 'volume_name': 'volume-3684caea-1d96-47cf-b1f1-1bdb27a42416', 'volume_size': 1, 'snapshot_id': '3773afea-1042-4bcf-a8f5-6ec60dd9eac0'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b219dc90-b9ab-4137-8255-4b74872ae68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b219dc90-b9ab-4137-8255-4b74872ae68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4389c756-35ec-45d8-8897-704fa154c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:20 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Volume 3684caea-1d96-47cf-b1f1-1bdb27a42416: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3684caea-1d96-47cf-b1f1-1bdb27a42416', 'volume_size': 1, 'snapshot_id': '3773afea-1042-4bcf-a8f5-6ec60dd9eac0'}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-quobyte-3773afea-1042-4bcf-a8f5-6ec60dd9eac0-3684caea-1d96-47cf-b1f1-1bdb27a42416" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3773afea-1042-4bcf-a8f5-6ec60dd9eac0-3684caea-1d96-47cf-b1f1-1bdb27a42416" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Creating volume 3684caea-1d96-47cf-b1f1-1bdb27a42416 from snapshot 3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-quobyte-3684caea-1d96-47cf-b1f1-1bdb27a42416" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3684caea-1d96-47cf-b1f1-1bdb27a42416" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] snapshot: 3773afea-1042-4bcf-a8f5-6ec60dd9eac0, volume: 3684caea-1d96-47cf-b1f1-1bdb27a42416,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26dfcd9-0d02-4e4a-a209-c8bb67e207e7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:20 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0
Jun 15 04:32:20 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:21 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0" returned: 0 in 0.728s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:32:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:32:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:32:21 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[917d1910-0f1d-4f7f-a24f-1111935f16a9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:21 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:21 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:22 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.755s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:22 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:32:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:22 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416
Jun 15 04:32:22 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416" returned: 0 in 5.449s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:27 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34bd196-28a4-4844-bd35-780458261963]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=75,cinder:INSERT=23,cinder:UPDATE=73,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:32:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:27 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:27 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:28 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.885s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:28 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:32:28 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Converted 1024.00 MB image at 187.89 MB/s
Jun 15 04:32:28 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 is being set with open permissions: ugo+rw
Jun 15 04:32:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:28 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416
Jun 15 04:32:28 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:29 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416" returned: 0 in 0.622s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3684caea-1d96-47cf-b1f1-1bdb27a42416" released by "_copy_volume_from_snapshot" :: held 8.540s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3773afea-1042-4bcf-a8f5-6ec60dd9eac0-3684caea-1d96-47cf-b1f1-1bdb27a42416" released by "_create_volume_from_snapshot" :: held 8.577s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.592s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.465s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5329be6e-62a0-4cc9-97eb-d7929d1a2d49]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4389c756-35ec-45d8-8897-704fa154c871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3684caea-1d96-47cf-b1f1-1bdb27a42416', 'volume_size': 1, 'snapshot_id': '3773afea-1042-4bcf-a8f5-6ec60dd9eac0'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1591f6-2d45-4a07-a889-49fa7dc13cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Volume volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 (3684caea-1d96-47cf-b1f1-1bdb27a42416): created successfully
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1591f6-2d45-4a07-a889-49fa7dc13cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Flow 'volume_create_manager' (4b3f9c13-15ce-440c-8ea9-8bd5ad6531a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d20e805c-1e4d-4eef-985c-36d0a338a447 tempest-SnapshotDependencyTests-477290925 None] Created volume successfully.
Jun 15 04:32:29 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b
Jun 15 04:32:29 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-3773afea-1042-4bcf-a8f5-6ec60dd9eac0-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-3773afea-1042-4bcf-a8f5-6ec60dd9eac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-quobyte-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-quobyte-3773afea-1042-4bcf-a8f5-6ec60dd9eac0" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3773afea-1042-4bcf-a8f5-6ec60dd9eac0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Deleting offline snapshot 3773afea-1042-4bcf-a8f5-6ec60dd9eac0 of volume 3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] snapshot_file for this snap is: volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d63fa3-294e-4ef9-9281-7a953736e887]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:29 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0
Jun 15 04:32:29 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:30 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b" returned: 0 in 0.809s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-5c053053-e3e5-47a1-8863-81766530140b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffea166b-09ef-4781-a1f6-2efa228bcfb6', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:32:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-f913b394-62c2-4818-a40b-989ef903a423 req-98bbce76-2930-493b-a9e5-cd7b662c2648 tempest-TestStampPattern-1189422319 None] attachment_update completed successfully.
Jun 15 04:32:30 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0" returned: 0 in 0.881s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c06345-2874-4eaa-9818-63b442b89bc1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:30 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:30 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:31 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.737s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:31 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0
Jun 15 04:32:31 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:32 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0" returned: 0 in 0.699s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:32 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0
Jun 15 04:32:32 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:32 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3.3773afea-1042-4bcf-a8f5-6ec60dd9eac0" returned: 0 in 0.610s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3773afea-1042-4bcf-a8f5-6ec60dd9eac0" released by "_delete_snapshot" :: held 3.034s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" released by "delete_snapshot" :: held 3.066s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Created reservations ['9f510667-9c59-4fe7-bf6c-4d4653db3a37', '8b5d830f-235b-4617-a24f-694aa7aae534', '809e01f7-c09f-4a8a-aa71-e92a063072c5', '8d8fca89-c2ce-4424-aeba-6e115306817e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Delete snapshot completed successfully.
Jun 15 04:32:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ecdc201e-21e6-4172-a571-a5734bacc414 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-3773afea-1042-4bcf-a8f5-6ec60dd9eac0-delete_snapshot" released by "delete_snapshot" :: held 3.200s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-3eb29422-58bd-45b0-a68e-c456e9c5d6a3-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-3eb29422-58bd-45b0-a68e-c456e9c5d6a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-quobyte-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[917f92a9-d4dd-452d-a545-b5c4e94ef556]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:34 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:34 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:34 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.770s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:34 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3
Jun 15 04:32:34 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:35 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" returned: 0 in 0.675s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3eb29422-58bd-45b0-a68e-c456e9c5d6a3" released by "delete_volume" :: held 1.525s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Created reservations ['eca81d6e-25a7-4aa5-bd9d-11193ca42942', '42041e73-facb-467f-b3a2-4c822d2063a9', 'cc49d151-35d3-43c5-ab8c-8aff56a5a21c', '7e55d369-ba21-4cb1-bcb4-139d87a09fbf'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:35 devstack sudo[108119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:35 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:35 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:35 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-3684caea-1d96-47cf-b1f1-1bdb27a42416-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-3684caea-1d96-47cf-b1f1-1bdb27a42416-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "cinder-quobyte-3684caea-1d96-47cf-b1f1-1bdb27a42416" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3684caea-1d96-47cf-b1f1-1bdb27a42416" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7816b0c4-9dbe-440b-8270-09e19c74e033]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:36 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.782s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:32:36 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Deleted volume successfully.
Jun 15 04:32:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-831a6dc0-f4a2-49df-bfd8-1ac6bcb78e47 tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-3eb29422-58bd-45b0-a68e-c456e9c5d6a3-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:36 devstack sudo[108125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416
Jun 15 04:32:36 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:37 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416" returned: 0 in 0.798s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:37 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416
Jun 15 04:32:37 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-b2e2f1e7-0c3d-4dfa-a47f-91d4abc29124 req-ce8c5d2f-8871-4365-88d3-ad800fec5146 tempest-TestStampPattern-1189422319 None] Terminate volume connection completed successfully.
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-b2e2f1e7-0c3d-4dfa-a47f-91d4abc29124 req-ce8c5d2f-8871-4365-88d3-ad800fec5146 tempest-TestStampPattern-1189422319 None] Deleting attachment ffea166b-09ef-4781-a1f6-2efa228bcfb6. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:32:37 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-3684caea-1d96-47cf-b1f1-1bdb27a42416" returned: 0 in 0.633s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-quobyte-3684caea-1d96-47cf-b1f1-1bdb27a42416" released by "delete_volume" :: held 1.479s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Created reservations ['b7c3926e-74ad-49af-912a-8c5b251b4854', 'a7dfc0de-da24-4c90-a768-080187d93b90', 'bb16c4e4-9f8e-440e-8e80-2e4653e4821f', '2485be2e-7e88-4a14-9983-8ba99d721ded'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:37 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:37 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Flow 'volume_create_manager' (dce25271-9ca7-4928-afc2-ccc385e008d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c817709e-d970-40a3-8835-8609c52095e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c817709e-d970-40a3-8835-8609c52095e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-388021121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87c9282-aaa8-454c-b5b8-e0a8ccaa136d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eda1ab039964e5a8252fa15d74b3b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:38Z,use_quota=True,user_id='e0a6ca3a829f4883bec8a3633cc275e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6d4eb0-571b-4704-b10f-22da63ac63de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6d4eb0-571b-4704-b10f-22da63ac63de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce671c86-a675-4b3c-92b2-adfa38cc7c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce671c86-a675-4b3c-92b2-adfa38cc7c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87c9282-aaa8-454c-b5b8-e0a8ccaa136d', 'volume_name': 'volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb3642e-d6c2-46d2-a3fa-d19226a19dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb3642e-d6c2-46d2-a3fa-d19226a19dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a631883-3090-4caf-a5ec-074765902690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:38 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Volume a87c9282-aaa8-454c-b5b8-e0a8ccaa136d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d', 'volume_size': 1}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-388021121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87c9282-aaa8-454c-b5b8-e0a8ccaa136d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eda1ab039964e5a8252fa15d74b3b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:38Z,use_quota=True,user_id='e0a6ca3a829f4883bec8a3633cc275e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Creating volume a87c9282-aaa8-454c-b5b8-e0a8ccaa136d {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:32:38 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:38 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d 1073741824
Jun 15 04:32:38 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:38 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.652s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Deleted volume successfully.
Jun 15 04:32:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-28d2225a-967c-4bf4-baf9-ab6f292af09a tempest-SnapshotDependencyTests-477290925 None] Lock "cinder-3684caea-1d96-47cf-b1f1-1bdb27a42416-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:39 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d 1073741824" returned: 0 in 0.875s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:39 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d
Jun 15 04:32:39 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:39 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d" returned: 0 in 0.642s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a631883-3090-4caf-a5ec-074765902690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4da109a-aeb3-4c44-b67d-97398bee7cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:39 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Volume volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d (a87c9282-aaa8-454c-b5b8-e0a8ccaa136d): created successfully
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4da109a-aeb3-4c44-b67d-97398bee7cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:39 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Flow 'volume_create_manager' (dce25271-9ca7-4928-afc2-ccc385e008d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:39 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c3b79dae-3b11-44ab-973e-ce95b2c2cbc3 tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Created volume successfully.
Jun 15 04:32:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Acquiring lock "cinder-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "cinder-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Acquiring lock "cinder-quobyte-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "cinder-quobyte-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d63b5-0107-47c1-8449-e3afaacf8378]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:41 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d
Jun 15 04:32:41 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:42 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d" returned: 0 in 0.795s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:42 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d
Jun 15 04:32:42 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:43 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d" returned: 0 in 0.749s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "cinder-quobyte-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d" released by "delete_volume" :: held 1.609s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Created reservations ['02948a08-0b72-4325-9359-48b6ff9d5905', '097d504b-e2bf-46c6-b91e-7dcca19831a9', '40d17883-dce8-4987-9a87-564ab5627c94', 'de098ae8-a724-4f72-8f06-ab0c6fc2c100'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:43 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:43 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:44 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.647s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:44 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Deleted volume successfully.
Jun 15 04:32:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3d1867c3-048c-44d1-9fd3-36b98c866ccf tempest-VolumeQuotasNegativeTestJSON-1461077838 None] Lock "cinder-a87c9282-aaa8-454c-b5b8-e0a8ccaa136d-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-5c053053-e3e5-47a1-8863-81766530140b-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Lock "cinder-5c053053-e3e5-47a1-8863-81766530140b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-quobyte-5c053053-e3e5-47a1-8863-81766530140b" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-5c053053-e3e5-47a1-8863-81766530140b" acquired by "delete_volume" :: waited 0.045s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:47 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e605247-9296-429b-b350-6e22e9e871e4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:47 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b
Jun 15 04:32:47 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:47 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b" returned: 0 in 0.820s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:47 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b
Jun 15 04:32:47 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:48 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5c053053-e3e5-47a1-8863-81766530140b" returned: 0 in 0.674s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-5c053053-e3e5-47a1-8863-81766530140b" released by "delete_volume" :: held 1.567s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Created reservations ['647659e9-f1de-4525-8da1-d1c3dec3ca76', '23174e69-8ef7-4c01-be66-93b084454173', '441fd332-c0aa-4433-8f52-b69f9e8749cf', '3aa15b21-dfa8-421f-bbab-52101e976169'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:48 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:32:48 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:49 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-bc560ba4-59b7-4f8e-b3b7-609e23224831-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.751s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:32:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Deleted volume successfully.
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Lock "cinder-bc560ba4-59b7-4f8e-b3b7-609e23224831-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-quobyte-b9567d68-1337-4110-b876-c7f0231cdf3e" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-190eb979-eca0-4476-9650-8bf24fa6917b tempest-TestStampPattern-1189422319 None] Lock "cinder-5c053053-e3e5-47a1-8863-81766530140b-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-b9567d68-1337-4110-b876-c7f0231cdf3e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-quobyte-bc560ba4-59b7-4f8e-b3b7-609e23224831" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Flow 'volume_create_manager' (e4bdb4cc-a24f-46c2-b37b-f194a342e8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc1e85a-45f5-4a10-afa2-f24029e0aa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-bc560ba4-59b7-4f8e-b3b7-609e23224831" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Deleting offline snapshot bc560ba4-59b7-4f8e-b3b7-609e23224831 of volume b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] snapshot_file for this snap is: volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc1e85a-45f5-4a10-afa2-f24029e0aa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-830060871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aea1931-629b-45b5-998d-cc8b3af61d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04225f7485634063b8d7f28a09221b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:50Z,use_quota=True,user_id='a0ab182b261347e3acdda51530ab8555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44760f99-1360-4a29-95a8-40bc7450cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44760f99-1360-4a29-95a8-40bc7450cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a0da8a-cc8c-4fee-8f92-db1c2467d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[49611938-c4ea-4453-a65f-100937fff2ba]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:49 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831
Jun 15 04:32:49 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a0da8a-cc8c-4fee-8f92-db1c2467d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9aea1931-629b-45b5-998d-cc8b3af61d86', 'volume_name': 'volume-9aea1931-629b-45b5-998d-cc8b3af61d86', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c3831ee0>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7737a06-6a67-43d1-9019-f89004ad0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7737a06-6a67-43d1-9019-f89004ad0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0afbb20-0a12-4fa5-aea6-43c9f1d67772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:49 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Volume 9aea1931-629b-45b5-998d-cc8b3af61d86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9aea1931-629b-45b5-998d-cc8b3af61d86', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c3831ee0>}
Jun 15 04:32:49 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Trying to clone 9aea1931-629b-45b5-998d-cc8b3af61d86 from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:32:50 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc2379-aab3-4fe3-97db-1a5d406be765]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:50 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831" returned: 0 in 0.735s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9567d68-1337-4110-b876-c7f0231cdf3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9520fc-1eeb-4c97-bb9b-44e1a1c2ee51]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:50 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD
Jun 15 04:32:50 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:50 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:32:50 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:51 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD" returned: 0 in 0.691s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde is fetched for user a0ab182b261347e3acdda51530ab8555. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dd425f-a2b1-4a6a-aad8-d17614598a1b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:51 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.706s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:51 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831
Jun 15 04:32:51 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:51 devstack sudo[108286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD
Jun 15 04:32:51 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:51 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-830060871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aea1931-629b-45b5-998d-cc8b3af61d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04225f7485634063b8d7f28a09221b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:32:50Z,use_quota=True,user_id='a0ab182b261347e3acdda51530ab8555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Creating volume 9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:32:51 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:51 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831" returned: 0 in 0.703s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:51 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 1073741824
Jun 15 04:32:51 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:51 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831
Jun 15 04:32:51 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:52 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e.bc560ba4-59b7-4f8e-b3b7-609e23224831" returned: 0 in 0.621s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-bc560ba4-59b7-4f8e-b3b7-609e23224831" released by "_delete_snapshot" :: held 2.886s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-b9567d68-1337-4110-b876-c7f0231cdf3e" released by "delete_snapshot" :: held 2.936s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Created reservations ['81e05b45-102f-4814-9eb6-aeb619b09fe6', 'bacb4e46-c8fd-41f4-b2f8-adb8015e47a0', 'a71c696c-bdeb-45d6-a0de-a2ee9494d2ae', '3fd45dc5-96dd-48d5-8fd4-49e3e841283f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:32:52 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 1073741824" returned: 0 in 0.776s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:52 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Delete snapshot completed successfully.
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-107c052b-c69d-4f97-ae13-a20aa98aadf5 tempest-TestStampPattern-1189422319 None] Lock "cinder-bc560ba4-59b7-4f8e-b3b7-609e23224831-delete_snapshot" released by "delete_snapshot" :: held 3.089s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:32:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:52 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:32:52 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:53 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 0 in 0.622s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:53 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:32:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:32:53 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Attempting download of 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume 9aea1931-629b-45b5-998d-cc8b3af61d86. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:32:53 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d0186-e4b2-44e6-8379-1b490256db3e]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:53 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:53 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7
Jun 15 04:32:53 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:54 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:54 devstack sudo[108314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7
Jun 15 04:32:54 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:54 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7" returned: 1 in 0.818s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ad3d500-cd6a-4357-9bcb-50810aab8cde_yp0esct7' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:32:54 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708c4cb-74e6-4ff7-84d9-307590dc31fe]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:54 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD
Jun 15 04:32:54 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:55 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD" returned: 0 in 0.743s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:55 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] 0ad3d500-cd6a-4357-9bcb-50810aab8cde was qcow2, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:32:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:55 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:32:55 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:57 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 0 in 1.828s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:57 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ad3d500-cd6a-4357-9bcb-50810aab8cde_jxtmovu4devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:32:57 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Converted 112.00 MB image at 61.21 MB/s
Jun 15 04:32:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:57 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 1G
Jun 15 04:32:57 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:58 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 1G" returned: 0 in 0.664s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba82543f-84d1-4a19-a75f-0c278a2ab5a8]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:32:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:58 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:32:58 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:58 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 0 in 0.707s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:32:58 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:32:58 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:32:59 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 1 in 0.699s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Downloaded image 0ad3d500-cd6a-4357-9bcb-50810aab8cde ((None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}])) to volume 9aea1931-629b-45b5-998d-cc8b3af61d86 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Temporary image 0ad3d500-cd6a-4357-9bcb-50810aab8cde for user a0ab182b261347e3acdda51530ab8555 is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Marking volume 9aea1931-629b-45b5-998d-cc8b3af61d86 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Copying metadata from image 0ad3d500-cd6a-4357-9bcb-50810aab8cde to 9aea1931-629b-45b5-998d-cc8b3af61d86. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Creating volume glance metadata for volume 9aea1931-629b-45b5-998d-cc8b3af61d86 backed by image 0ad3d500-cd6a-4357-9bcb-50810aab8cde with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0afbb20-0a12-4fa5-aea6-43c9f1d67772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aea1931-629b-45b5-998d-cc8b3af61d86', 'volume_size': 1, 'image_id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4fe33baf49d34a0dad0349547fede1be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ad3d500-cd6a-4357-9bcb-50810aab8cde', 'created_at': datetime.datetime(2026, 6, 15, 2, 8, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 8, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ad3d500-cd6a-4357-9bcb-50810aab8cde/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496c3831ee0>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11b53e7-fd9e-4a7b-89af-c264d9b678aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:32:59 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Volume volume-9aea1931-629b-45b5-998d-cc8b3af61d86 (9aea1931-629b-45b5-998d-cc8b3af61d86): created successfully
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11b53e7-fd9e-4a7b-89af-c264d9b678aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Flow 'volume_create_manager' (e4bdb4cc-a24f-46c2-b37b-f194a342e8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:32:59 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-363f9388-269d-4d11-83aa-a58ca6912917 tempest-VolumesExtendTest-1944162445 None] Created volume successfully.
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-b9567d68-1337-4110-b876-c7f0231cdf3e-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Lock "cinder-b9567d68-1337-4110-b876-c7f0231cdf3e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Acquiring lock "cinder-quobyte-b9567d68-1337-4110-b876-c7f0231cdf3e" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-b9567d68-1337-4110-b876-c7f0231cdf3e" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:32:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e5021-91f7-4d6a-97d6-2cdf75d11fc6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:00 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:33:00 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[440511df-426a-40da-add1-36e007e8953b]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:00 devstack sudo[108393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:33:00 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:00 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.738s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:00 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e
Jun 15 04:33:00 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:01 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 0 in 0.722s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:01 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:33:01 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:01 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b9567d68-1337-4110-b876-c7f0231cdf3e" returned: 0 in 0.645s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Lock "cinder-quobyte-b9567d68-1337-4110-b876-c7f0231cdf3e" released by "delete_volume" :: held 1.458s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Created reservations ['ff1d6fcb-2fc3-4377-94a1-12d0a5da57e9', 'c43560d3-85ef-4842-8f93-c196c63c1ac3', '9961eca2-961e-433b-a3c6-e14ac3fa9675', '3d85c942-06ee-4a78-84f4-b5af4ea233c8'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:01 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:01 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:01 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 1 in 0.709s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 2G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 2G" returned: 0 in 0.062s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.544s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:01 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-74edf51c-9312-44b7-b769-ce5fcac0ef79 tempest-VolumesExtendTest-1944162445 None] Extend volume completed successfully.
Jun 15 04:33:02 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.612s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Deleted volume successfully.
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-712ce06e-cb4a-41f9-af7e-762e93e65f82 tempest-TestStampPattern-1189422319 None] Lock "cinder-b9567d68-1337-4110-b876-c7f0231cdf3e-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-9aea1931-629b-45b5-998d-cc8b3af61d86-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-9aea1931-629b-45b5-998d-cc8b3af61d86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-quobyte-9aea1931-629b-45b5-998d-cc8b3af61d86" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-9aea1931-629b-45b5-998d-cc8b3af61d86" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656ce9b-ea8c-4bc4-8a49-95cff0434bea]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:02 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:33:02 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:03 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 0 in 0.727s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:03 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:33:03 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:04 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 1 in 0.713s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:33:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:04 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86
Jun 15 04:33:04 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:04 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9aea1931-629b-45b5-998d-cc8b3af61d86" returned: 0 in 0.616s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-9aea1931-629b-45b5-998d-cc8b3af61d86" released by "delete_volume" :: held 2.122s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:04 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Created reservations ['1d94a8f2-3f77-48b0-b012-25dedb8bb3ec', 'acc04da0-eeec-4cd1-998f-b6dce02ac3a2', '4888be49-f91b-4158-a66c-643e70052790', '4b9af027-2962-416e-b37f-cc9a4f753f03'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:05 devstack sudo[108430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:05 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:05 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.628s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Deleted volume successfully.
Jun 15 04:33:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c410d369-1ec3-40e8-9bab-b321d7668c05 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-9aea1931-629b-45b5-998d-cc8b3af61d86-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Flow 'volume_create_manager' (db40e7dd-84a3-4f85-ae14-bf4dea2a43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9983488-1dce-45da-9a8e-a207e19dc5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9983488-1dce-45da-9a8e-a207e19dc5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1473786026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3008e0-d035-4a30-9f54-6f323db571b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04225f7485634063b8d7f28a09221b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:06Z,use_quota=True,user_id='a0ab182b261347e3acdda51530ab8555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3211fed8-a418-4c49-adfe-9e2ce8e1a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3211fed8-a418-4c49-adfe-9e2ce8e1a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cbbc20-d2bc-4df0-a7f1-6df2ed822f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cbbc20-d2bc-4df0-a7f1-6df2ed822f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3008e0-d035-4a30-9f54-6f323db571b9', 'volume_name': 'volume-0a3008e0-d035-4a30-9f54-6f323db571b9', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc17d529-4b76-4708-b9d8-c99202122a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc17d529-4b76-4708-b9d8-c99202122a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6cde24-3913-480f-946f-6baaafa95986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:06 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Volume 0a3008e0-d035-4a30-9f54-6f323db571b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3008e0-d035-4a30-9f54-6f323db571b9', 'volume_size': 1}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1473786026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3008e0-d035-4a30-9f54-6f323db571b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04225f7485634063b8d7f28a09221b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:06Z,use_quota=True,user_id='a0ab182b261347e3acdda51530ab8555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Creating volume 0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:06 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:06 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 1073741824
Jun 15 04:33:06 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:07 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 1073741824" returned: 0 in 0.831s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:07 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9
Jun 15 04:33:07 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:07 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9" returned: 0 in 0.625s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6cde24-3913-480f-946f-6baaafa95986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3008e0-d035-4a30-9f54-6f323db571b9', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d5eddc-4ed9-4c68-a031-7d0e20a1d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Volume volume-0a3008e0-d035-4a30-9f54-6f323db571b9 (0a3008e0-d035-4a30-9f54-6f323db571b9): created successfully
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d5eddc-4ed9-4c68-a031-7d0e20a1d160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Flow 'volume_create_manager' (db40e7dd-84a3-4f85-ae14-bf4dea2a43bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-05e93ba6-04e5-4bc4-8c9c-06362e2198f9 tempest-VolumesExtendTest-1944162445 None] Created volume successfully.
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Creating offline snapshot ddc9616c-3a48-4427-8498-910ab504e8dd of volume 0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[61148dd3-c7ed-4473-b2f3-0958ebd588eb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:08 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9
Jun 15 04:33:08 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:09 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9" returned: 0 in 0.796s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:09 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd 1G
Jun 15 04:33:09 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:10 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd 1G" returned: 0 in 0.804s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3008e0-d035-4a30-9f54-6f323db571b9 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:10 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3008e0-d035-4a30-9f54-6f323db571b9 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd
Jun 15 04:33:10 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:11 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a3008e0-d035-4a30-9f54-6f323db571b9 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd" returned: 0 in 0.673s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:11 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd is being set with open permissions: ugo+rw
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:11 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd
Jun 15 04:33:11 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:11 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd" returned: 0 in 0.607s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:11 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info
Jun 15 04:33:11 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (7d5aa9db-4d39-4124-902b-8b58a9c01960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683da833-7d90-426b-9488-30f55f4db51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:11 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683da833-7d90-426b-9488-30f55f4db51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915008969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79d51be-9d47-429f-9c09-91d356040a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:12Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d962ae8-8871-447f-9a77-fd9020b333fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d962ae8-8871-447f-9a77-fd9020b333fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d6742b-b56c-4f6d-8bf1-2a4abbf60971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d6742b-b56c-4f6d-8bf1-2a4abbf60971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd79d51be-9d47-429f-9c09-91d356040a20', 'volume_name': 'volume-d79d51be-9d47-429f-9c09-91d356040a20', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20900c62-fdc9-4c2b-8f65-0f5703f9a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20900c62-fdc9-4c2b-8f65-0f5703f9a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03be11ed-c2a1-4896-a11f-9dcd70a2713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:12 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume d79d51be-9d47-429f-9c09-91d356040a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d79d51be-9d47-429f-9c09-91d356040a20', 'volume_size': 1}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:12 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info" returned: 0 in 0.657s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:12 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info is being set with open permissions: ugo+rw
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:12 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info
Jun 15 04:33:12 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:12 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.info" returned: 0 in 0.586s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.272s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915008969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79d51be-9d47-429f-9c09-91d356040a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:12Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Creating volume d79d51be-9d47-429f-9c09-91d356040a20 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:12 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:12 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20 1073741824
Jun 15 04:33:12 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5e831bb3-106e-4e2b-9d25-edba481588ae tempest-VolumesExtendTest-1944162445 None] Create snapshot completed successfully
Jun 15 04:33:13 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20 1073741824" returned: 0 in 0.743s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:13 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20
Jun 15 04:33:13 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:14 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20" returned: 0 in 0.594s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.342s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03be11ed-c2a1-4896-a11f-9dcd70a2713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d79d51be-9d47-429f-9c09-91d356040a20', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d675acc6-037d-4e29-b201-f8da61d58f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b2594-0837-47df-b087-a85e43c998e0]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:14 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume volume-d79d51be-9d47-429f-9c09-91d356040a20 (d79d51be-9d47-429f-9c09-91d356040a20): created successfully
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d675acc6-037d-4e29-b201-f8da61d58f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (7d5aa9db-4d39-4124-902b-8b58a9c01960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5cb9ce6f-d18a-40f2-ac46-d577e2199a62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created volume successfully.
Jun 15 04:33:14 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9
Jun 15 04:33:14 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:15 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9" returned: 0 in 0.714s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd 2G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd 2G" returned: 0 in 0.132s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.890s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=77,cinder:INSERT=27,cinder:UPDATE=79,cinder:DELETE=5 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:33:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9f2fa8c5-7685-482b-805b-32b9f621e4b1 tempest-VolumesExtendTest-1944162445 None] Extend volume completed successfully.
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (a63141ef-d71b-4ee6-b903-36625fbedb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681afdb7-dd6b-4ea4-84ff-54dee0574290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681afdb7-dd6b-4ea4-84ff-54dee0574290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648814746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bb35a3-8aae-4e01-87bc-f63d95389c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:15Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd4d9dd-a149-4b69-9308-487b4504c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd4d9dd-a149-4b69-9308-487b4504c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250ab028-af45-4be2-b169-67eaf2b77dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250ab028-af45-4be2-b169-67eaf2b77dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4bb35a3-8aae-4e01-87bc-f63d95389c54', 'volume_name': 'volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8caa449-6e72-4520-b087-7f230cd3d7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8caa449-6e72-4520-b087-7f230cd3d7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cbb9ef-964f-451a-b3d1-68f57ffbfaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume e4bb35a3-8aae-4e01-87bc-f63d95389c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54', 'volume_size': 1}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648814746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bb35a3-8aae-4e01-87bc-f63d95389c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:15Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Creating volume e4bb35a3-8aae-4e01-87bc-f63d95389c54 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:15 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:15 devstack sudo[108489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 1073741824
Jun 15 04:33:15 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (e20262e1-f9ca-4c21-9c88-cbc7308f7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11535ca3-ebc4-4ba0-926f-c274b080c48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11535ca3-ebc4-4ba0-926f-c274b080c48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100130191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b7026f-c89c-4634-880d-cfcd1e687115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:16Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034d1777-33a6-4842-957b-71192da891f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034d1777-33a6-4842-957b-71192da891f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c95e05-c283-4e0a-972d-8bff9986be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c95e05-c283-4e0a-972d-8bff9986be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b7026f-c89c-4634-880d-cfcd1e687115', 'volume_name': 'volume-d1b7026f-c89c-4634-880d-cfcd1e687115', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c8cb3-8983-441e-8671-acb5d4398447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c8cb3-8983-441e-8671-acb5d4398447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca71244-d9b6-4aee-8473-a2241ab690b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:15 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume d1b7026f-c89c-4634-880d-cfcd1e687115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b7026f-c89c-4634-880d-cfcd1e687115', 'volume_size': 1}
Jun 15 04:33:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-ddc9616c-3a48-4427-8498-910ab504e8dd-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-ddc9616c-3a48-4427-8498-910ab504e8dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-quobyte-0a3008e0-d035-4a30-9f54-6f323db571b9" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-0a3008e0-d035-4a30-9f54-6f323db571b9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-quobyte-ddc9616c-3a48-4427-8498-910ab504e8dd" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-ddc9616c-3a48-4427-8498-910ab504e8dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Deleting offline snapshot ddc9616c-3a48-4427-8498-910ab504e8dd of volume 0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] snapshot_file for this snap is: volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9732f4d4-eaa1-4d81-9050-9dc78f67ee5f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:16 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd
Jun 15 04:33:16 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (cd116e02-f45f-4177-a1f2-1ffccd951cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:16 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39e23d0-afaa-4f22-9002-22160741ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 1073741824" returned: 0 in 0.963s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39e23d0-afaa-4f22-9002-22160741ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-638622783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114ad1c3-2e14-47ee-ad93-269a398b277a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:16Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866c1943-c6f8-4d45-ad0d-4542bc58fd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866c1943-c6f8-4d45-ad0d-4542bc58fd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09f6fe9-f21b-4f0d-a668-7b11d594223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09f6fe9-f21b-4f0d-a668-7b11d594223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114ad1c3-2e14-47ee-ad93-269a398b277a', 'volume_name': 'volume-114ad1c3-2e14-47ee-ad93-269a398b277a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d326da-5f4f-439d-99b9-b0d3e98a1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d326da-5f4f-439d-99b9-b0d3e98a1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41661be-9774-44fe-8964-e4d981bab6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume 114ad1c3-2e14-47ee-ad93-269a398b277a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114ad1c3-2e14-47ee-ad93-269a398b277a', 'volume_size': 1}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:16 devstack sudo[108498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54
Jun 15 04:33:16 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (4cd141bf-713c-4336-bf61-467dc3926be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672397b6-b69f-4a52-bfdb-85b5aa6237bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672397b6-b69f-4a52-bfdb-85b5aa6237bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-413578588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70feee54-a6c2-41a6-8461-a003ab5ced4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:17Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be901871-4016-4750-9283-d28406b5000c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be901871-4016-4750-9283-d28406b5000c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:16 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e2899f-4567-43fe-bb7d-275b3c94bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e2899f-4567-43fe-bb7d-275b3c94bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70feee54-a6c2-41a6-8461-a003ab5ced4b', 'volume_name': 'volume-70feee54-a6c2-41a6-8461-a003ab5ced4b', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3288b06f-0ef7-45f8-9a00-76ebf63c3acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3288b06f-0ef7-45f8-9a00-76ebf63c3acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d676c19b-462e-4fc4-a7eb-e53b035019ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume 70feee54-a6c2-41a6-8461-a003ab5ced4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70feee54-a6c2-41a6-8461-a003ab5ced4b', 'volume_size': 1}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (bbf15f57-bbc6-405e-983b-d14a7743a4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2740b8-7891-43bc-8a5b-96b40cecc1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd" returned: 0 in 0.898s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a3008e0-d035-4a30-9f54-6f323db571b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2740b8-7891-43bc-8a5b-96b40cecc1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697845668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3851ef7-662e-460d-ae47-90fcb17fafd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:17Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0309e9b5-223f-441c-95ad-c05327a345fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0309e9b5-223f-441c-95ad-c05327a345fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2b4c6d-a35c-4723-a5b9-d7727b35c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2b4c6d-a35c-4723-a5b9-d7727b35c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3851ef7-662e-460d-ae47-90fcb17fafd0', 'volume_name': 'volume-c3851ef7-662e-460d-ae47-90fcb17fafd0', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb1ee5f-5fc7-4166-b8de-36c2dcbfa000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb1ee5f-5fc7-4166-b8de-36c2dcbfa000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f113af-bd1b-4648-b9ec-41f710ebdb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume c3851ef7-662e-460d-ae47-90fcb17fafd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3851ef7-662e-460d-ae47-90fcb17fafd0', 'volume_size': 1}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f5ed86-a783-48b6-afaf-a2a5c6043b13]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54" returned: 0 in 0.724s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100130191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b7026f-c89c-4634-880d-cfcd1e687115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:16Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Creating volume d1b7026f-c89c-4634-880d-cfcd1e687115 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:17 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cbb9ef-964f-451a-b3d1-68f57ffbfaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03425ad2-1814-4403-ae4b-661d937bf5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:17 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115 1073741824
Jun 15 04:33:17 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:17 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 (e4bb35a3-8aae-4e01-87bc-f63d95389c54): created successfully
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03425ad2-1814-4403-ae4b-661d937bf5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:17 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (a63141ef-d71b-4ee6-b903-36625fbedb30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-98a7b386-24b9-4553-8bd8-afa988e4cb74 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created volume successfully.
Jun 15 04:33:17 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9
Jun 15 04:33:17 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:18 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9" returned: 0 in 0.722s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:18 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd
Jun 15 04:33:18 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:18 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115 1073741824" returned: 0 in 0.795s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:18 devstack sudo[108517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115
Jun 15 04:33:18 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:18 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd" returned: 0 in 0.699s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:18 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd
Jun 15 04:33:18 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:18 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115" returned: 0 in 0.627s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-638622783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114ad1c3-2e14-47ee-ad93-269a398b277a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:16Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Creating volume 114ad1c3-2e14-47ee-ad93-269a398b277a {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:18 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca71244-d9b6-4aee-8473-a2241ab690b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b7026f-c89c-4634-880d-cfcd1e687115', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:18 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a 1073741824
Jun 15 04:33:18 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50926cd3-3b18-4e47-ba55-dc75361804cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:18 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume volume-d1b7026f-c89c-4634-880d-cfcd1e687115 (d1b7026f-c89c-4634-880d-cfcd1e687115): created successfully
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50926cd3-3b18-4e47-ba55-dc75361804cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:18 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (e20262e1-f9ca-4c21-9c88-cbc7308f7279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:18 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b58a3bc4-86c5-4bff-81d2-5f0e2f9c9c84 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created volume successfully.
Jun 15 04:33:19 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9.ddc9616c-3a48-4427-8498-910ab504e8dd" returned: 0 in 0.622s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-ddc9616c-3a48-4427-8498-910ab504e8dd" released by "_delete_snapshot" :: held 3.099s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-0a3008e0-d035-4a30-9f54-6f323db571b9" released by "delete_snapshot" :: held 3.129s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Created reservations ['d0f53a81-5e46-4af5-a57e-83292332c7f0', 'f7f2bd28-2c0f-4bd7-8e9e-f49b2e29307b', '57b8acec-f7a5-4fd4-af7a-1c931caadf92', '88dea48b-88fd-4f7d-b22d-1c89c083635f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Delete snapshot completed successfully.
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-391a6d2f-fddf-4418-9b99-683a82f17381 tempest-VolumesExtendTest-1944162445 None] Lock "cinder-ddc9616c-3a48-4427-8498-910ab504e8dd-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:19 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a 1073741824" returned: 0 in 0.816s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:19 devstack sudo[108532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a
Jun 15 04:33:19 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:20 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a" returned: 0 in 0.596s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-413578588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70feee54-a6c2-41a6-8461-a003ab5ced4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:17Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Creating volume 70feee54-a6c2-41a6-8461-a003ab5ced4b {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:20 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41661be-9774-44fe-8964-e4d981bab6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114ad1c3-2e14-47ee-ad93-269a398b277a', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:20 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b 1073741824
Jun 15 04:33:20 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746189d5-4f2b-4b99-9343-5778d6df8ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:20 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume volume-114ad1c3-2e14-47ee-ad93-269a398b277a (114ad1c3-2e14-47ee-ad93-269a398b277a): created successfully
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746189d5-4f2b-4b99-9343-5778d6df8ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (cd116e02-f45f-4177-a1f2-1ffccd951cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8ac7021a-d8dd-484a-a66d-8d47257e2aba tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created volume successfully.
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-0a3008e0-d035-4a30-9f54-6f323db571b9-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Lock "cinder-0a3008e0-d035-4a30-9f54-6f323db571b9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Acquiring lock "cinder-quobyte-0a3008e0-d035-4a30-9f54-6f323db571b9" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-0a3008e0-d035-4a30-9f54-6f323db571b9" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[17508411-96ae-4234-8195-6445ac061a12]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:20 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9
Jun 15 04:33:20 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:21 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b 1073741824" returned: 0 in 0.771s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:21 devstack sudo[108543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b
Jun 15 04:33:21 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:21 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9" returned: 0 in 0.723s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:21 devstack sudo[108548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9
Jun 15 04:33:21 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:21 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b" returned: 0 in 0.613s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.378s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697845668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3851ef7-662e-460d-ae47-90fcb17fafd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b6beac9d8048df87004cfb409f3d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:17Z,use_quota=True,user_id='cb735a7bbefd4e7ab03b21eeb7633c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Creating volume c3851ef7-662e-460d-ae47-90fcb17fafd0 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:21 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:21 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 1073741824
Jun 15 04:33:21 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d676c19b-462e-4fc4-a7eb-e53b035019ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70feee54-a6c2-41a6-8461-a003ab5ced4b', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdf9a41-2846-4e70-b783-8e94c021fb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume volume-70feee54-a6c2-41a6-8461-a003ab5ced4b (70feee54-a6c2-41a6-8461-a003ab5ced4b): created successfully
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdf9a41-2846-4e70-b783-8e94c021fb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (4cd141bf-713c-4336-bf61-467dc3926be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:21 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-434cc55d-9a1b-4f73-90b2-502cac0413a2 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created volume successfully.
Jun 15 04:33:21 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0a3008e0-d035-4a30-9f54-6f323db571b9" returned: 0 in 0.586s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Lock "cinder-quobyte-0a3008e0-d035-4a30-9f54-6f323db571b9" released by "delete_volume" :: held 1.367s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Created reservations ['80da3fce-6572-4fe5-84d0-9aa1d1ee96f7', 'deafa19d-db69-40ba-a0f9-21086f14adad', 'c06b0e8c-bfde-4672-a778-d332be05ee3f', 'ec930b37-1fcb-4bcb-ac86-d19b004fca53'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:22 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:22 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:22 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 1073741824" returned: 0 in 0.781s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:22 devstack sudo[108559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0
Jun 15 04:33:22 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:22 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.603s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:22 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Deleted volume successfully.
Jun 15 04:33:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cfcf80ea-8cda-48ba-b039-b003807bfeaa tempest-VolumesExtendTest-1944162445 None] Lock "cinder-0a3008e0-d035-4a30-9f54-6f323db571b9-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:23 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0" returned: 0 in 0.637s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f113af-bd1b-4648-b9ec-41f710ebdb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3851ef7-662e-460d-ae47-90fcb17fafd0', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c28825-aad9-477c-b4ef-d1fd2719d969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:23 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Volume volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 (c3851ef7-662e-460d-ae47-90fcb17fafd0): created successfully
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c28825-aad9-477c-b4ef-d1fd2719d969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Flow 'volume_create_manager' (bbf15f57-bbc6-405e-983b-d14a7743a4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-faabc74e-8d2e-40be-8c70-3715f29e3fc5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created volume successfully.
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-c3851ef7-662e-460d-ae47-90fcb17fafd0-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-c3851ef7-662e-460d-ae47-90fcb17fafd0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-quobyte-c3851ef7-662e-460d-ae47-90fcb17fafd0" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-c3851ef7-662e-460d-ae47-90fcb17fafd0" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:24 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8f94c8-b019-4738-bfd4-44967f1338da]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:24 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0
Jun 15 04:33:24 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:24 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0" returned: 0 in 0.740s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:24 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0
Jun 15 04:33:24 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:25 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c3851ef7-662e-460d-ae47-90fcb17fafd0" returned: 0 in 0.637s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-c3851ef7-662e-460d-ae47-90fcb17fafd0" released by "delete_volume" :: held 1.420s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created reservations ['b315ca2e-0ae6-41f9-8bc2-dcd6f0092b10', '1e41d70f-1ad6-41e2-a35e-3e31771a5228', '12a96c35-f735-460e-b245-f04b9c939e17', '9a97f938-7f37-462a-adf6-bd0ba5527c98'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:25 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:25 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Flow 'volume_create_manager' (42a9f6ec-c25d-4483-b2c5-60e3a51a886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eff952b-1f7c-4c05-b42a-804a82d88d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eff952b-1f7c-4c05-b42a-804a82d88d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2050560527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9688b03b-c8a9-4bfa-92d6-434d76364adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d071b87150449f1ba57866f52c140b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:26Z,use_quota=True,user_id='2574e2a7a3b14e7198c5ebbad53dd91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8651ace8-a1ad-4887-b6ea-1ae0449fbfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8651ace8-a1ad-4887-b6ea-1ae0449fbfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6977b0fb-41c7-4fdb-9de1-728b1ee90a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6977b0fb-41c7-4fdb-9de1-728b1ee90a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9688b03b-c8a9-4bfa-92d6-434d76364adb', 'volume_name': 'volume-9688b03b-c8a9-4bfa-92d6-434d76364adb', 'volume_size': 2}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f432776d-aab4-480e-95fc-b4cb0188a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f432776d-aab4-480e-95fc-b4cb0188a98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa77ed3-6437-407a-9729-9f5b389d5400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:25 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Volume 9688b03b-c8a9-4bfa-92d6-434d76364adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9688b03b-c8a9-4bfa-92d6-434d76364adb', 'volume_size': 2}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2050560527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9688b03b-c8a9-4bfa-92d6-434d76364adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d071b87150449f1ba57866f52c140b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:26Z,use_quota=True,user_id='2574e2a7a3b14e7198c5ebbad53dd91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Creating volume 9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:25 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb 2147483648 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:25 devstack sudo[108574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb 2147483648
Jun 15 04:33:25 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:26 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.622s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:26 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Deleted volume successfully.
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-70feee54-a6c2-41a6-8461-a003ab5ced4b-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-70feee54-a6c2-41a6-8461-a003ab5ced4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cc0e2175-0bba-4046-8d0a-f916413b7082 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-c3851ef7-662e-460d-ae47-90fcb17fafd0-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-quobyte-70feee54-a6c2-41a6-8461-a003ab5ced4b" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-70feee54-a6c2-41a6-8461-a003ab5ced4b" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8fb36-5a4c-4127-b069-f9c9b903a3e1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:26 devstack sudo[108577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b
Jun 15 04:33:26 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:26 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb 2147483648" returned: 0 in 0.875s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:26 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb
Jun 15 04:33:26 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:27 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b" returned: 0 in 0.736s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:27 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b
Jun 15 04:33:27 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:27 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb" returned: 0 in 0.621s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa77ed3-6437-407a-9729-9f5b389d5400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9688b03b-c8a9-4bfa-92d6-434d76364adb', 'volume_size': 2}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29d5680-f3f5-49d4-8505-71576d012dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Volume volume-9688b03b-c8a9-4bfa-92d6-434d76364adb (9688b03b-c8a9-4bfa-92d6-434d76364adb): created successfully
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29d5680-f3f5-49d4-8505-71576d012dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Flow 'volume_create_manager' (42a9f6ec-c25d-4483-b2c5-60e3a51a886f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:27 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-70becf23-82f3-489f-a251-442914146257 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Created volume successfully.
Jun 15 04:33:27 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-70feee54-a6c2-41a6-8461-a003ab5ced4b" returned: 0 in 0.603s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-70feee54-a6c2-41a6-8461-a003ab5ced4b" released by "delete_volume" :: held 1.379s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created reservations ['3114daf1-9d16-45f0-8ea5-e271d1f88bda', '377e59cd-feb1-4b17-a5aa-0950807f08ac', '8b44726a-cb1f-45a0-8156-c5a1fa310c04', 'a3ecb16e-3def-4a8a-a19a-e72cc50cc229'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:27 devstack sudo[108599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:27 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=136,cinder:DELETE=13,cinder:SELECT=103,cinder:INSERT=37 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Creating offline snapshot d062273f-29fe-4232-8920-edbe9d5784d4 of volume 9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302c33e-541d-4b6f-8e94-de83c9748af1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:28 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb
Jun 15 04:33:28 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:28 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.604s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:28 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Deleted volume successfully.
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-370e5f72-ccb1-4e7f-a20a-0235c95677b5 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-70feee54-a6c2-41a6-8461-a003ab5ced4b-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-114ad1c3-2e14-47ee-ad93-269a398b277a-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-114ad1c3-2e14-47ee-ad93-269a398b277a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-quobyte-114ad1c3-2e14-47ee-ad93-269a398b277a" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-114ad1c3-2e14-47ee-ad93-269a398b277a" acquired by "delete_volume" :: waited 0.028s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb87f31a-f7f3-4dd6-8415-a857863357a7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:28 devstack sudo[108604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a
Jun 15 04:33:28 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:28 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb" returned: 0 in 0.739s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 2G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:28 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 2G
Jun 15 04:33:28 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:29 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a" returned: 0 in 0.711s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:29 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a
Jun 15 04:33:29 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:29 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 2G" returned: 0 in 0.738s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9688b03b-c8a9-4bfa-92d6-434d76364adb -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:29 devstack sudo[108619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9688b03b-c8a9-4bfa-92d6-434d76364adb -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4
Jun 15 04:33:29 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:29 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-114ad1c3-2e14-47ee-ad93-269a398b277a" returned: 0 in 0.631s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-114ad1c3-2e14-47ee-ad93-269a398b277a" released by "delete_volume" :: held 1.382s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created reservations ['53295803-e5ce-4ab8-9711-2ce06bc5d69f', 'e6007872-3200-4487-81c3-2972a6c3a0ec', '250b6ae5-7639-4ad6-96ea-b69b23372753', '894ef2eb-087e-4c57-8f10-69130e0954cf'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:30 devstack sudo[108622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:30 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:30 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9688b03b-c8a9-4bfa-92d6-434d76364adb -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:30 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 is being set with open permissions: ugo+rw
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:30 devstack sudo[108627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4
Jun 15 04:33:30 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:30 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Deleted volume successfully.
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4abb55dc-919f-4edf-89eb-5e2dcbc202f8 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-114ad1c3-2e14-47ee-ad93-269a398b277a-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-d1b7026f-c89c-4634-880d-cfcd1e687115-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-d1b7026f-c89c-4634-880d-cfcd1e687115-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-quobyte-d1b7026f-c89c-4634-880d-cfcd1e687115" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-d1b7026f-c89c-4634-880d-cfcd1e687115" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a6c2a1-7a7a-47ad-88a5-cccc17445fa6]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:30 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4" returned: 0 in 0.632s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:30 devstack sudo[108632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115
Jun 15 04:33:30 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:30 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info
Jun 15 04:33:30 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:31 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:31 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115" returned: 0 in 0.727s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info" returned: 0 in 0.595s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:31 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info is being set with open permissions: ugo+rw
Jun 15 04:33:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:31 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115
Jun 15 04:33:31 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:31 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info
Jun 15 04:33:31 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:32 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d1b7026f-c89c-4634-880d-cfcd1e687115" returned: 0 in 0.598s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-d1b7026f-c89c-4634-880d-cfcd1e687115" released by "delete_volume" :: held 1.366s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:32 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.info" returned: 0 in 0.607s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.065s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7ffca75e-5dda-4a77-9ace-62bdd98a64ac tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Create snapshot completed successfully
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created reservations ['b24726fe-5de8-4464-a0fa-116674c71ba6', '6b3510c1-4c06-4888-8247-9f6c6e6d6136', '8da3f845-84b4-496a-a737-79e7d092d932', 'dc414424-3df6-44f0-9811-7d6e76d29ee3'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:32 devstack sudo[108646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:32 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:32 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.577s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Deleted volume successfully.
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-df2f8bf3-b8eb-4375-a035-1fd0636acc62 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-d1b7026f-c89c-4634-880d-cfcd1e687115-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-e4bb35a3-8aae-4e01-87bc-f63d95389c54-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-e4bb35a3-8aae-4e01-87bc-f63d95389c54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-quobyte-e4bb35a3-8aae-4e01-87bc-f63d95389c54" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-e4bb35a3-8aae-4e01-87bc-f63d95389c54" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29dbe4c-d3f4-4e41-9b59-e1d63e6115e8]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:33 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54
Jun 15 04:33:33 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "cinder-d062273f-29fe-4232-8920-edbe9d5784d4-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-d062273f-29fe-4232-8920-edbe9d5784d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "cinder-quobyte-9688b03b-c8a9-4bfa-92d6-434d76364adb" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-quobyte-9688b03b-c8a9-4bfa-92d6-434d76364adb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "cinder-quobyte-d062273f-29fe-4232-8920-edbe9d5784d4" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-quobyte-d062273f-29fe-4232-8920-edbe9d5784d4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Deleting offline snapshot d062273f-29fe-4232-8920-edbe9d5784d4 of volume 9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] snapshot_file for this snap is: volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45d320-6505-4e37-a54b-498fdfb20f46]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:33 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4
Jun 15 04:33:33 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:33 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54" returned: 0 in 0.723s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:33 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54
Jun 15 04:33:33 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:34 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4" returned: 0 in 0.715s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9688b03b-c8a9-4bfa-92d6-434d76364adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d8c5e0-d79e-40b4-aea7-7dbb94ad39fb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:34 devstack sudo[108661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb
Jun 15 04:33:34 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:34 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e4bb35a3-8aae-4e01-87bc-f63d95389c54" returned: 0 in 0.603s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-e4bb35a3-8aae-4e01-87bc-f63d95389c54" released by "delete_volume" :: held 1.373s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created reservations ['c4c69e66-980f-4873-a140-95297b013369', 'fee4fe6b-4d93-454a-9a8a-2812ecf84e33', 'e60ac815-7efe-4ce1-ad94-8d2452652f01', 'd669b18e-0f87-4f0f-a03b-3f90e16a9474'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:34 devstack sudo[108664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:34 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:34 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb" returned: 0 in 0.709s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:34 devstack sudo[108669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4
Jun 15 04:33:34 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:35 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.630s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:35 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Deleted volume successfully.
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-d79d51be-9d47-429f-9c09-91d356040a20-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e57c0ddf-5baa-4f8c-95c0-50551125fec9 tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-e4bb35a3-8aae-4e01-87bc-f63d95389c54-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-d79d51be-9d47-429f-9c09-91d356040a20-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "cinder-quobyte-d79d51be-9d47-429f-9c09-91d356040a20" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-d79d51be-9d47-429f-9c09-91d356040a20" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f68e489-c3a2-4375-8d09-e82727a30a17]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:35 devstack sudo[108672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20
Jun 15 04:33:35 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:35 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:35 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:35 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4" returned: 0 in 0.741s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:35 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4
Jun 15 04:33:35 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:36 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20" returned: 0 in 0.772s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:36 devstack sudo[108685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20
Jun 15 04:33:36 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:36 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:33:36 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb.d062273f-29fe-4232-8920-edbe9d5784d4" returned: 0 in 0.613s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-quobyte-d062273f-29fe-4232-8920-edbe9d5784d4" released by "_delete_snapshot" :: held 2.884s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-quobyte-9688b03b-c8a9-4bfa-92d6-434d76364adb" released by "delete_snapshot" :: held 2.911s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Created reservations ['3d9ce206-1393-40a4-a728-5229363f92cf', '2af8e903-360e-4306-b103-c7db99df2e28', '4141e058-b531-43c3-9173-45ca251ae0d4', '9645b608-3640-43d3-b9ea-3e14cc30bae7'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Delete snapshot completed successfully.
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-02c9315b-56ed-4b29-8a37-9e36ea78c507 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-d062273f-29fe-4232-8920-edbe9d5784d4-delete_snapshot" released by "delete_snapshot" :: held 3.041s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "cinder-9688b03b-c8a9-4bfa-92d6-434d76364adb-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:36 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d79d51be-9d47-429f-9c09-91d356040a20" returned: 0 in 0.596s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-9688b03b-c8a9-4bfa-92d6-434d76364adb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-quobyte-d79d51be-9d47-429f-9c09-91d356040a20" released by "delete_volume" :: held 1.412s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "cinder-quobyte-9688b03b-c8a9-4bfa-92d6-434d76364adb" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-quobyte-9688b03b-c8a9-4bfa-92d6-434d76364adb" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef76bd98-f1bc-4179-bf28-f848e0495549]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Created reservations ['1c653143-fb52-43f1-891b-9e9b3055487e', '5217ebc4-faac-4e47-bfc9-4710917a034f', 'bfb9741c-ed95-43c7-a6eb-2ac84202a369', '70dd0a4a-764a-444f-93ce-b42f47513c1a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:36 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb
Jun 15 04:33:36 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:36 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:36 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:37 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.623s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:37 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Deleted volume successfully.
Jun 15 04:33:37 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb" returned: 0 in 0.744s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-921179de-44a1-4aa6-86e6-dceea0e3842b tempest-CreateVolumesFromSourceVolumeTest-498487044 None] Lock "cinder-d79d51be-9d47-429f-9c09-91d356040a20-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:37 devstack sudo[108697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb
Jun 15 04:33:37 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:38 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-9688b03b-c8a9-4bfa-92d6-434d76364adb" returned: 0 in 0.645s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-quobyte-9688b03b-c8a9-4bfa-92d6-434d76364adb" released by "delete_volume" :: held 1.448s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Created reservations ['a88bd606-33f6-4698-a829-0150a5a80eed', '3022b928-87e3-4259-850a-90f031bd0bb5', 'd4dfaa8f-693a-44d2-af46-2b42c43935b7', '0f83d391-1ea4-4047-bdc4-685a16cfd9d9'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:38 devstack sudo[108700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:33:38 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:38 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.665s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:33:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Deleted volume successfully.
Jun 15 04:33:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-61e4377d-1720-480f-a3a0-a9f95cb039f3 tempest-VolumesSnapshotNegativeTestJSON-33072182 None] Lock "cinder-9688b03b-c8a9-4bfa-92d6-434d76364adb-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Flow 'volume_create_manager' (1cb15c8e-33e8-4a39-8aec-aaaecac104f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b3978-a9ec-4285-b1de-3b80d74ca393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15b3978-a9ec-4285-b1de-3b80d74ca393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1077548401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55f981c-774a-4c5f-9c94-eae7f50c65b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c21648dbc504693b386573a69ff4992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:40Z,use_quota=True,user_id='f388c2e9043f48a8a06f39f28af5cc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8664f22c-a74b-4008-a8b3-c0aeecf91288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8664f22c-a74b-4008-a8b3-c0aeecf91288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfca8811-8f13-4355-8eb2-cbc1c9de1a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfca8811-8f13-4355-8eb2-cbc1c9de1a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55f981c-774a-4c5f-9c94-eae7f50c65b1', 'volume_name': 'volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd7d5f1-69dc-4163-ab34-4fbe8e50ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd7d5f1-69dc-4163-ab34-4fbe8e50ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0b0579-5cdb-4a9c-93c8-dea5cfd4cbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:40 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Volume a55f981c-774a-4c5f-9c94-eae7f50c65b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1', 'volume_size': 1}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1077548401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55f981c-774a-4c5f-9c94-eae7f50c65b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c21648dbc504693b386573a69ff4992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:40Z,use_quota=True,user_id='f388c2e9043f48a8a06f39f28af5cc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Creating volume a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:40 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:33:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:40 devstack sudo[108703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 1073741824
Jun 15 04:33:40 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:41 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 1073741824" returned: 0 in 0.801s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:41 devstack sudo[108710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:33:41 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:41 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.602s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0b0579-5cdb-4a9c-93c8-dea5cfd4cbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda9d9ad-8202-455f-9c12-42ebb10b48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:41 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Volume volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 (a55f981c-774a-4c5f-9c94-eae7f50c65b1): created successfully
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda9d9ad-8202-455f-9c12-42ebb10b48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:41 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Flow 'volume_create_manager' (1cb15c8e-33e8-4a39-8aec-aaaecac104f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:41 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-83c2d868-b653-472b-8bd1-927cb6bd14f2 tempest-VolumeDependencyTests-231154442 None] Created volume successfully.
Jun 15 04:33:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:42 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Creating offline snapshot dabb6344-c8f9-4544-a5d7-e03d3026d303 of volume a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:33:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c75fb0-427e-4a7e-bc50-97d27128d188]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:42 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:33:42 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:43 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.757s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:43 devstack sudo[108718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 1G
Jun 15 04:33:43 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:44 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 1G" returned: 0 in 0.786s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:44 devstack sudo[108724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303
Jun 15 04:33:44 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:44 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:44 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 is being set with open permissions: ugo+rw
Jun 15 04:33:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:44 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303
Jun 15 04:33:44 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:45 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303" returned: 0 in 0.664s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:45 devstack sudo[108768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info
Jun 15 04:33:45 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:46 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info" returned: 0 in 0.618s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:46 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info is being set with open permissions: ugo+rw
Jun 15 04:33:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:46 devstack sudo[108771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info
Jun 15 04:33:46 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:46 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.info" returned: 0 in 0.615s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.235s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0169926c-284c-49fa-93f5-9d00b1ce03b9 tempest-VolumeDependencyTests-231154442 None] Create snapshot completed successfully
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Flow 'volume_create_manager' (f9d237a1-e10a-4bfd-98b8-a447882213ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a5dad6-8428-46b5-ab68-f90f259544eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a5dad6-8428-46b5-ab68-f90f259544eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1945182851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb9f447-8cfd-480c-8bd2-abc2ee351958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c21648dbc504693b386573a69ff4992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dabb6344-c8f9-4544-a5d7-e03d3026d303,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:33:48Z,use_quota=True,user_id='f388c2e9043f48a8a06f39f28af5cc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe09520-e92f-4aba-b7ed-d75312e187d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe09520-e92f-4aba-b7ed-d75312e187d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d4b415-278b-41e1-9642-2f7d2cb043ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d4b415-278b-41e1-9642-2f7d2cb043ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cb9f447-8cfd-480c-8bd2-abc2ee351958', 'volume_name': 'volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958', 'volume_size': 1, 'snapshot_id': 'dabb6344-c8f9-4544-a5d7-e03d3026d303'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06bc28c-6736-47b3-a38d-71c0b38eeda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06bc28c-6736-47b3-a38d-71c0b38eeda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e246a88d-e934-47bc-8a16-90351a75cac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:48 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Volume 5cb9f447-8cfd-480c-8bd2-abc2ee351958: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958', 'volume_size': 1, 'snapshot_id': 'dabb6344-c8f9-4544-a5d7-e03d3026d303'}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-quobyte-dabb6344-c8f9-4544-a5d7-e03d3026d303-5cb9f447-8cfd-480c-8bd2-abc2ee351958" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-dabb6344-c8f9-4544-a5d7-e03d3026d303-5cb9f447-8cfd-480c-8bd2-abc2ee351958" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Creating volume 5cb9f447-8cfd-480c-8bd2-abc2ee351958 from snapshot dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-quobyte-5cb9f447-8cfd-480c-8bd2-abc2ee351958" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-5cb9f447-8cfd-480c-8bd2-abc2ee351958" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] snapshot: dabb6344-c8f9-4544-a5d7-e03d3026d303, volume: 5cb9f447-8cfd-480c-8bd2-abc2ee351958,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f172f4-e8e5-4e80-91f6-2db9ae619603]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:48 devstack sudo[108774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303
Jun 15 04:33:48 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:49 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303" returned: 0 in 0.712s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:33:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:33:49 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:33:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9eb55c-2e55-4437-a845-3393d6278755]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:49 devstack sudo[108779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:33:49 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:50 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.819s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:50 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:33:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:50 devstack sudo[108784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958
Jun 15 04:33:50 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:55 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958" returned: 0 in 5.406s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ddd31-3408-4bc1-9792-2f73c2bd7b2a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:55 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:33:55 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:56 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.893s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:33:56 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Converted 1024.00 MB image at 189.37 MB/s
Jun 15 04:33:56 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 is being set with open permissions: ugo+rw
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:56 devstack sudo[108803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958
Jun 15 04:33:56 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:56 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-5cb9f447-8cfd-480c-8bd2-abc2ee351958" released by "_copy_volume_from_snapshot" :: held 8.548s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-dabb6344-c8f9-4544-a5d7-e03d3026d303-5cb9f447-8cfd-480c-8bd2-abc2ee351958" released by "_create_volume_from_snapshot" :: held 8.579s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:33:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.595s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e246a88d-e934-47bc-8a16-90351a75cac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958', 'volume_size': 1, 'snapshot_id': 'dabb6344-c8f9-4544-a5d7-e03d3026d303'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701501b6-b26c-4fd6-b240-6cfd45286c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:33:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Volume volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 (5cb9f447-8cfd-480c-8bd2-abc2ee351958): created successfully
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701501b6-b26c-4fd6-b240-6cfd45286c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Flow 'volume_create_manager' (f9d237a1-e10a-4bfd-98b8-a447882213ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:33:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-9fb2e43e-2938-400a-adb3-91dfd7678dac tempest-VolumeDependencyTests-231154442 None] Created volume successfully.
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-dabb6344-c8f9-4544-a5d7-e03d3026d303-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-dabb6344-c8f9-4544-a5d7-e03d3026d303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-quobyte-a55f981c-774a-4c5f-9c94-eae7f50c65b1" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-a55f981c-774a-4c5f-9c94-eae7f50c65b1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-quobyte-dabb6344-c8f9-4544-a5d7-e03d3026d303" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-dabb6344-c8f9-4544-a5d7-e03d3026d303" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Deleting offline snapshot dabb6344-c8f9-4544-a5d7-e03d3026d303 of volume a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] snapshot_file for this snap is: volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e42ed-9d95-49fe-9b0c-87fd7eae0a2a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:57 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303
Jun 15 04:33:57 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:58 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303" returned: 0 in 0.781s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:33:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc02fcf-4725-461a-8d74-863a0127f075]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:33:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:58 devstack sudo[108811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:33:58 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:58 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.724s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:58 devstack sudo[108816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303
Jun 15 04:33:58 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:33:59 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root
Jun 15 04:33:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303" returned: 0 in 0.721s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:33:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:33:59 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303
Jun 15 04:33:59 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:00 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1.dabb6344-c8f9-4544-a5d7-e03d3026d303" returned: 0 in 0.634s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-dabb6344-c8f9-4544-a5d7-e03d3026d303" released by "_delete_snapshot" :: held 2.983s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-a55f981c-774a-4c5f-9c94-eae7f50c65b1" released by "delete_snapshot" :: held 3.009s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Created reservations ['13eef200-9628-41c2-b619-bf7c87230628', '16bbd48c-b758-4f97-9aa8-a6b6114548fa', '781498ca-31bc-4058-be3b-a5bcab5ae028', 'e0d3f0d7-abd6-49f1-8098-5121ce1a564a'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:34:00 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Delete snapshot completed successfully.
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ead92753-cea4-4f33-94bd-69f7a9d1e559 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-dabb6344-c8f9-4544-a5d7-e03d3026d303-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-a55f981c-774a-4c5f-9c94-eae7f50c65b1-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-a55f981c-774a-4c5f-9c94-eae7f50c65b1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-quobyte-a55f981c-774a-4c5f-9c94-eae7f50c65b1" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-a55f981c-774a-4c5f-9c94-eae7f50c65b1" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceba6e3-4799-467c-bb79-07cca58dffe1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:34:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:00 devstack sudo[108824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:34:00 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:01 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.798s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:01 devstack sudo[108831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1
Jun 15 04:34:01 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:02 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a55f981c-774a-4c5f-9c94-eae7f50c65b1" returned: 0 in 0.650s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-a55f981c-774a-4c5f-9c94-eae7f50c65b1" released by "delete_volume" :: held 1.515s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Created reservations ['e0b33999-3f53-4d43-bc4d-5ef100228717', 'e807e357-8292-46b7-871d-5a63dbb8711d', '3d732652-2d82-4bee-a91c-3f29a3d51f59', '61cffbd5-7571-4990-8fda-ff109d76b748'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:02 devstack sudo[108835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:34:02 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-5cb9f447-8cfd-480c-8bd2-abc2ee351958-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-5cb9f447-8cfd-480c-8bd2-abc2ee351958-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "cinder-quobyte-5cb9f447-8cfd-480c-8bd2-abc2ee351958" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-5cb9f447-8cfd-480c-8bd2-abc2ee351958" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:34:02 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.659s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:34:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Deleted volume successfully.
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4363084-cb78-483f-bbbe-d8ed70317b9f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-0542a216-9209-47d8-9cfb-856fe65e5be5 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-a55f981c-774a-4c5f-9c94-eae7f50c65b1-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:03 devstack sudo[108839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958
Jun 15 04:34:03 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:03 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958" returned: 0 in 0.794s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:03 devstack sudo[108845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958
Jun 15 04:34:03 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:04 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5cb9f447-8cfd-480c-8bd2-abc2ee351958" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-quobyte-5cb9f447-8cfd-480c-8bd2-abc2ee351958" released by "delete_volume" :: held 1.526s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Created reservations ['61d15f54-d123-45ff-89f6-2ea93b9d9cff', '1cfbcdff-b594-449f-9b2e-a5230657dad0', 'd2159a9c-ee65-493a-9923-6c542212bcc7', 'eee4f863-3d27-4bb6-9b3f-2e60a7fcd7f5'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:34:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:04 devstack sudo[108848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:34:04 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:05 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.651s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:05 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:34:05 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Deleted volume successfully.
Jun 15 04:34:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5f426ac5-ce57-4bed-ba88-1aa1963105f2 tempest-VolumeDependencyTests-231154442 None] Lock "cinder-5cb9f447-8cfd-480c-8bd2-abc2ee351958-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:34:14 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:DELETE=4,cinder:UPDATE=72,cinder:SELECT=57,cinder:INSERT=18 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:34:15 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=93,cinder:INSERT=31,cinder:UPDATE=126,cinder:DELETE=11 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Flow 'volume_create_manager' (d3351d08-64f9-40ec-8f90-98765d30bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076f91fc-7335-453a-bb0a-8660bd92a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076f91fc-7335-453a-bb0a-8660bd92a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-145651950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ead159c-2b4d-40a3-bdb5-1b045f5a52af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fcd32b9b694f1a9ee158c7ebcd7a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:34:23Z,use_quota=True,user_id='6204a2e37bdf4902b7dcaa2e019652e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb5451a-f8b3-410e-a9b4-77cd3377f1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb5451a-f8b3-410e-a9b4-77cd3377f1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e297dd-326c-4ef6-9b59-dbfed6e14d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e297dd-326c-4ef6-9b59-dbfed6e14d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ead159c-2b4d-40a3-bdb5-1b045f5a52af', 'volume_name': 'volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e696d6c-af36-4268-aac6-9bfafa6e61a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e696d6c-af36-4268-aac6-9bfafa6e61a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32109c72-460f-45f8-bd01-8cde819b3a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:34:22 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Volume 0ead159c-2b4d-40a3-bdb5-1b045f5a52af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af', 'volume_size': 1}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-145651950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ead159c-2b4d-40a3-bdb5-1b045f5a52af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fcd32b9b694f1a9ee158c7ebcd7a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:34:23Z,use_quota=True,user_id='6204a2e37bdf4902b7dcaa2e019652e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Creating volume 0ead159c-2b4d-40a3-bdb5-1b045f5a52af {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:34:22 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:34:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:22 devstack sudo[108957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af 1073741824
Jun 15 04:34:22 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:23 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af 1073741824" returned: 0 in 0.772s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:23 devstack sudo[108963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af
Jun 15 04:34:23 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:24 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" returned: 0 in 0.596s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32109c72-460f-45f8-bd01-8cde819b3a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f81bbf7-23d8-47d3-945f-f8d29ebbc0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:34:24 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Volume volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af (0ead159c-2b4d-40a3-bdb5-1b045f5a52af): created successfully
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f81bbf7-23d8-47d3-945f-f8d29ebbc0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:34:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Flow 'volume_create_manager' (d3351d08-64f9-40ec-8f90-98765d30bd66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:34:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-56b82556-3b14-4750-a9ca-696189443084 tempest-TestMinimumBasicScenario-612880992 None] Created volume successfully.
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099417b-1fcb-407f-9e65-08258a2bfeaf]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:28 devstack sudo[108982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af
Jun 15 04:34:28 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:28 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" returned: 0 in 0.733s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.750s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:34:28 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac', 'name': 'volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0008101-1e67-461d-baea-98a5b4fd6ba6', 'enforce_multipath': True} {{(pid=92103) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 04:34:28 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-868b526b-4786-4a31-a159-f164188e1579 req-eb2d0825-99d8-4b7f-a4eb-b1dbf5d57c5b tempest-TestMinimumBasicScenario-612880992 None] attachment_update completed successfully.
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:34:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:34:35 devstack sudo[109398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:34:35 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:34:36 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root
Jun 15 04:34:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:34:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:34:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:34:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:34:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:34:38 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:34:38 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:35:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [req-d1bef5ba-2464-4c85-a6e3-8d4bb6e31081 req-251ddb42-bd2d-4af5-8c3b-a786e508d1d1 tempest-TestMinimumBasicScenario-612880992 None] Terminate volume connection completed successfully.
Jun 15 04:35:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [req-d1bef5ba-2464-4c85-a6e3-8d4bb6e31081 req-251ddb42-bd2d-4af5-8c3b-a786e508d1d1 tempest-TestMinimumBasicScenario-612880992 None] Deleting attachment b0008101-1e67-461d-baea-98a5b4fd6ba6. {{(pid=92103) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 04:35:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Acquiring lock "cinder-0ead159c-2b4d-40a3-bdb5-1b045f5a52af-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Lock "cinder-0ead159c-2b4d-40a3-bdb5-1b045f5a52af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Acquiring lock "cinder-quobyte-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Lock "cinder-quobyte-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:15 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[058e08e6-6ac6-466b-8a74-33aeb324d21f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:35:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:15 devstack sudo[109626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af
Jun 15 04:35:15 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:16 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" returned: 0 in 0.704s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:16 devstack sudo[109631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af
Jun 15 04:35:16 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:17 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" returned: 0 in 0.595s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Lock "cinder-quobyte-0ead159c-2b4d-40a3-bdb5-1b045f5a52af" released by "delete_volume" :: held 1.340s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Created reservations ['cc24392d-d5b5-47da-8822-43a7205eea70', 'a5e38c14-5739-4dff-aae2-a6cc6ad3d65b', '0d4cbc08-c559-474f-b2df-a67a1b9bb7c2', '136e04a0-c73b-44b4-99c4-191b0131d53e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:17 devstack sudo[109634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:35:17 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:17 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.607s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:35:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Deleted volume successfully.
Jun 15 04:35:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-fa7025cf-22f9-4158-93bc-82e6da38a7f6 tempest-TestMinimumBasicScenario-612880992 None] Lock "cinder-0ead159c-2b4d-40a3-bdb5-1b045f5a52af-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:35:27 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Flow 'volume_create_manager' (9fe0d704-9232-4cf5-adc3-d971cd6d4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35e8e33-55cc-4a91-8977-9df8d8233928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35e8e33-55cc-4a91-8977-9df8d8233928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c365f89-7afd-4c4c-8565-ba2f3fb59a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880c5235b644451a71bd28ca9581e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:35:35Z,use_quota=True,user_id='179900c96581460398bef46b32ceb229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9010686-4aa5-4d3d-b4b3-68edc41fa2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9010686-4aa5-4d3d-b4b3-68edc41fa2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd39b3b5-d95e-4a6f-91b7-62ba7120d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd39b3b5-d95e-4a6f-91b7-62ba7120d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c365f89-7afd-4c4c-8565-ba2f3fb59a13', 'volume_name': 'volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4716b10-03ba-4fa8-ba6f-b5b8c2e520fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4716b10-03ba-4fa8-ba6f-b5b8c2e520fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1591bbb5-a651-4314-8571-48773fec1068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:34 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Volume 6c365f89-7afd-4c4c-8565-ba2f3fb59a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13', 'volume_size': 1}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c365f89-7afd-4c4c-8565-ba2f3fb59a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880c5235b644451a71bd28ca9581e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:35:35Z,use_quota=True,user_id='179900c96581460398bef46b32ceb229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Creating volume 6c365f89-7afd-4c4c-8565-ba2f3fb59a13 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:35:34 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:35:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:34 devstack sudo[109745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 1073741824
Jun 15 04:35:34 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:35 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 1073741824" returned: 0 in 0.769s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:35 devstack sudo[109751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13
Jun 15 04:35:35 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:35 devstack sudo[109752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:35:35 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:36 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13" returned: 0 in 0.599s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:36 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.590s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1591bbb5-a651-4314-8571-48773fec1068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123d8704-7b00-48ea-993f-b97ec7205b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:36 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Volume volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 (6c365f89-7afd-4c4c-8565-ba2f3fb59a13): created successfully
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123d8704-7b00-48ea-993f-b97ec7205b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Flow 'volume_create_manager' (9fe0d704-9232-4cf5-adc3-d971cd6d4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:35:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-0cef715f-a4be-4c71-85bd-d154336ffdfb tempest-CinderUnicodeTest-1403405599 None] Created volume successfully.
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Flow 'volume_create_manager' (c1d47b1e-5ba3-4f52-9fe7-a13da4c74c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001d3ef7-96f5-4d11-b2eb-09dd75ad0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001d3ef7-96f5-4d11-b2eb-09dd75ad0f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:35:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-748538323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ce15a4-1837-460e-9664-c41d04a2e2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880c5235b644451a71bd28ca9581e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:35:37Z,use_quota=True,user_id='179900c96581460398bef46b32ceb229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339cf310-1ab8-4194-825b-ac0ad0b75db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339cf310-1ab8-4194-825b-ac0ad0b75db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2051807f-5360-40b4-bed1-fe0d8c8cade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2051807f-5360-40b4-bed1-fe0d8c8cade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ce15a4-1837-460e-9664-c41d04a2e2d3', 'volume_name': 'volume-50ce15a4-1837-460e-9664-c41d04a2e2d3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac18bc04-1a04-4f9a-afbe-33489b2da364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac18bc04-1a04-4f9a-afbe-33489b2da364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222c67d1-d668-4ee4-99c3-03c61dc4606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Volume 50ce15a4-1837-460e-9664-c41d04a2e2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ce15a4-1837-460e-9664-c41d04a2e2d3', 'volume_size': 1}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:35:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-748538323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ce15a4-1837-460e-9664-c41d04a2e2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880c5235b644451a71bd28ca9581e09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:35:37Z,use_quota=True,user_id='179900c96581460398bef46b32ceb229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Creating volume 50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:35:37 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:37 devstack sudo[109757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 1073741824
Jun 15 04:35:37 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:37 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 1073741824" returned: 0 in 0.737s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:37 devstack sudo[109763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3
Jun 15 04:35:37 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:38 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3" returned: 0 in 0.589s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222c67d1-d668-4ee4-99c3-03c61dc4606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ce15a4-1837-460e-9664-c41d04a2e2d3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dd0454-79f4-41f4-9de0-46b2a43d3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:35:38 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Volume volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 (50ce15a4-1837-460e-9664-c41d04a2e2d3): created successfully
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dd0454-79f4-41f4-9de0-46b2a43d3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:35:38 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Flow 'volume_create_manager' (c1d47b1e-5ba3-4f52-9fe7-a13da4c74c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:35:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-44011a48-0d0e-4329-82cf-ad943248e5c4 tempest-CinderUnicodeTest-1403405599 None] Created volume successfully.
Jun 15 04:35:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Creating offline snapshot 81c8a2b9-35b6-4e4b-9bd7-43e053021c43 of volume 50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:35:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8bfdd-f5bf-49be-bcc1-5ca4fcc38f84]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:35:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:39 devstack sudo[109766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3
Jun 15 04:35:39 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:40 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3" returned: 0 in 0.691s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:40 devstack sudo[109771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 1G
Jun 15 04:35:40 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:40 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 1G" returned: 0 in 0.738s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:40 devstack sudo[109777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43
Jun 15 04:35:40 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:41 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43" returned: 0 in 0.618s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:41 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 is being set with open permissions: ugo+rw
Jun 15 04:35:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:41 devstack sudo[109782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43
Jun 15 04:35:41 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:42 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43" returned: 0 in 0.577s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:42 devstack sudo[109785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info
Jun 15 04:35:42 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:42 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info" returned: 0 in 0.581s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:42 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info is being set with open permissions: ugo+rw
Jun 15 04:35:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:42 devstack sudo[109788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info
Jun 15 04:35:42 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:43 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.info" returned: 0 in 0.573s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.858s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:43 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e57cb0eb-fc09-47cf-aa21-d8b0370767ea tempest-CinderUnicodeTest-1403405599 None] Create snapshot completed successfully
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-81c8a2b9-35b6-4e4b-9bd7-43e053021c43-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-81c8a2b9-35b6-4e4b-9bd7-43e053021c43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-quobyte-50ce15a4-1837-460e-9664-c41d04a2e2d3" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-50ce15a4-1837-460e-9664-c41d04a2e2d3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-quobyte-81c8a2b9-35b6-4e4b-9bd7-43e053021c43" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-81c8a2b9-35b6-4e4b-9bd7-43e053021c43" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Deleting offline snapshot 81c8a2b9-35b6-4e4b-9bd7-43e053021c43 of volume 50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] snapshot_file for this snap is: volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[585450b7-35ad-4f36-b42b-224f178fcb2e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:35:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:43 devstack sudo[109791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43
Jun 15 04:35:43 devstack sudo[109791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:44 devstack sudo[109791]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43" returned: 0 in 0.692s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50ce15a4-1837-460e-9664-c41d04a2e2d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:35:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04578cd-57bc-4466-8716-cbf305515c35]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:35:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:44 devstack sudo[109796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3
Jun 15 04:35:44 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:45 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3" returned: 0 in 0.696s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:45 devstack sudo[109801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43
Jun 15 04:35:45 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:45 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43" returned: 0 in 0.670s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:45 devstack sudo[109840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43
Jun 15 04:35:45 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:46 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3.81c8a2b9-35b6-4e4b-9bd7-43e053021c43" returned: 0 in 0.595s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-81c8a2b9-35b6-4e4b-9bd7-43e053021c43" released by "_delete_snapshot" :: held 2.750s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-50ce15a4-1837-460e-9664-c41d04a2e2d3" released by "delete_snapshot" :: held 2.771s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Created reservations ['bdb281b3-0f0f-4639-8476-59a248268f77', 'aaebcd9c-d6b5-40c4-97ff-775a73486356', 'acfb0059-a11c-40bc-9403-f781547e54b4', '03d25909-7368-4dec-937e-8aba785549a0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:35:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Delete snapshot completed successfully.
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e4be9b79-b3e2-47a4-8895-b71c8703fc2c tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-81c8a2b9-35b6-4e4b-9bd7-43e053021c43-delete_snapshot" released by "delete_snapshot" :: held 2.895s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-50ce15a4-1837-460e-9664-c41d04a2e2d3-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-50ce15a4-1837-460e-9664-c41d04a2e2d3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-quobyte-50ce15a4-1837-460e-9664-c41d04a2e2d3" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-50ce15a4-1837-460e-9664-c41d04a2e2d3" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe6c5a-0cd9-4d17-a296-b091395d93f9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:35:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:46 devstack sudo[109845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3
Jun 15 04:35:46 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:47 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3" returned: 0 in 0.693s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:47 devstack sudo[109850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3
Jun 15 04:35:47 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:48 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-50ce15a4-1837-460e-9664-c41d04a2e2d3" returned: 0 in 0.581s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-50ce15a4-1837-460e-9664-c41d04a2e2d3" released by "delete_volume" :: held 1.327s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Created reservations ['000ad38f-4d26-4796-b312-42ffa19d0368', 'b40f90f3-6464-4f40-889b-28ab78c05087', '7c875e2e-a0ca-41cc-a2a9-14debf6aafe8', '07423cd8-b089-4579-919f-83349aa76afd'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:48 devstack sudo[109853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:35:48 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:48 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.575s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:35:48 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Deleted volume successfully.
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5cb436b5-a3e8-4b5d-aa89-75dfe37dd339 tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-50ce15a4-1837-460e-9664-c41d04a2e2d3-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-6c365f89-7afd-4c4c-8565-ba2f3fb59a13-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-6c365f89-7afd-4c4c-8565-ba2f3fb59a13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "cinder-quobyte-6c365f89-7afd-4c4c-8565-ba2f3fb59a13" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:35:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-6c365f89-7afd-4c4c-8565-ba2f3fb59a13" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:35:49 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcdf760-ac15-44b1-b67a-3a23acabcf8b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:35:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:49 devstack sudo[109856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13
Jun 15 04:35:49 devstack sudo[109856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:49 devstack sudo[109856]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13" returned: 0 in 0.688s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:49 devstack sudo[109861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13
Jun 15 04:35:49 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:50 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-6c365f89-7afd-4c4c-8565-ba2f3fb59a13" returned: 0 in 0.597s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-quobyte-6c365f89-7afd-4c4c-8565-ba2f3fb59a13" released by "delete_volume" :: held 1.325s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Created reservations ['fcec2ffb-5376-4345-88be-2d67eda22be5', '45203374-4ac1-4790-afc7-c11e299100fc', '53c88459-ecfa-4e4f-bf13-5c9ba1346847', 'e0761061-d893-41e4-ac93-851a9ff840a5'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:35:50 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:35:50 devstack sudo[109864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:35:50 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:35:51 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root
Jun 15 04:35:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.579s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:35:51 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:35:51 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Deleted volume successfully.
Jun 15 04:35:51 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-caa892d1-f93f-4f0c-8486-cd37c132707b tempest-CinderUnicodeTest-1403405599 None] Lock "cinder-6c365f89-7afd-4c4c-8565-ba2f3fb59a13-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:00 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=27,cinder:UPDATE=32,cinder:INSERT=8 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:36:01 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=5 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:36:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (55c791d9-cdc2-452f-9b42-5d08861fcf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfce7654-620f-40ce-96ba-c8d8450a7297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (e923d6b8-ec8f-4a0e-a10e-540918870ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b1ddd-cd55-41aa-9d14-2e5e0f0bebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfce7654-620f-40ce-96ba-c8d8450a7297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889130547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1229e02f-f0c9-41bc-a5a2-11c33d409edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:03Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d27d81e-7fbe-4b8e-b727-207c6b99e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d27d81e-7fbe-4b8e-b727-207c6b99e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6fb108-63f0-47db-b8cd-20c8dec43b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6fb108-63f0-47db-b8cd-20c8dec43b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1229e02f-f0c9-41bc-a5a2-11c33d409edc', 'volume_name': 'volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8888bcc4-c497-4ac8-b92b-2eb530756307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8888bcc4-c497-4ac8-b92b-2eb530756307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee23af3-d9d3-4e90-a1e2-230cc8eea74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume 1229e02f-f0c9-41bc-a5a2-11c33d409edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc', 'volume_size': 1}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889130547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1229e02f-f0c9-41bc-a5a2-11c33d409edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:03Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating volume 1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:03 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b1ddd-cd55-41aa-9d14-2e5e0f0bebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1280418605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d130f146-12e7-438e-88f0-45c4012a2241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:03Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddf0f60-777f-4977-bbe7-33a0262ff379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddf0f60-777f-4977-bbe7-33a0262ff379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack sudo[109909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc 1073741824
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093a6ed0-c72d-4531-b5a4-9cf699b9c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093a6ed0-c72d-4531-b5a4-9cf699b9c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd130f146-12e7-438e-88f0-45c4012a2241', 'volume_name': 'volume-d130f146-12e7-438e-88f0-45c4012a2241', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8691ca-f0bc-4b6c-8e23-9757ec758eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8691ca-f0bc-4b6c-8e23-9757ec758eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822d16ad-a5f3-4906-ae44-493e9c1e5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Volume d130f146-12e7-438e-88f0-45c4012a2241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d130f146-12e7-438e-88f0-45c4012a2241', 'volume_size': 1}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (31ec9f58-c82f-43e8-82a6-96f739c377fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04772ee-df13-4e59-9984-195202435414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04772ee-df13-4e59-9984-195202435414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1717980060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04df544e-99bd-4326-ab5b-9adab58e3351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:03Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcc2407-8fca-47a4-a6e0-2607d3b4a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcc2407-8fca-47a4-a6e0-2607d3b4a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53abe68c-dbf6-4e67-83ff-72658c7c6dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53abe68c-dbf6-4e67-83ff-72658c7c6dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04df544e-99bd-4326-ab5b-9adab58e3351', 'volume_name': 'volume-04df544e-99bd-4326-ab5b-9adab58e3351', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56948064-fc14-4835-bc42-75cbf763cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56948064-fc14-4835-bc42-75cbf763cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e1b7f1-6de8-4300-b8cf-3a2b10b65981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Volume 04df544e-99bd-4326-ab5b-9adab58e3351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04df544e-99bd-4326-ab5b-9adab58e3351', 'volume_size': 1}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Flow 'volume_create_manager' (e4246789-60df-435c-ab55-35fbbbd64d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b212859c-3e40-458a-b044-9c2cb15e599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b212859c-3e40-458a-b044-9c2cb15e599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabbbac6-57b3-459a-aa1c-b5a90e986f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5d015c78954aa3acadea250a924cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:04Z,use_quota=True,user_id='47d29c638d5243a99d0cd026c5b52d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0c8de5-d57b-4461-a691-ffc3d6359bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0c8de5-d57b-4461-a691-ffc3d6359bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345d021-a5b5-4f81-84de-26687ad62187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345d021-a5b5-4f81-84de-26687ad62187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabbbac6-57b3-459a-aa1c-b5a90e986f39', 'volume_name': 'volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209ac700-feb2-45a7-96d4-74e9cfb1089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209ac700-feb2-45a7-96d4-74e9cfb1089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ae3cb3-243a-491c-b3f2-4bdf35436228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Volume aabbbac6-57b3-459a-aa1c-b5a90e986f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39', 'volume_size': 1}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (72477fda-df0b-4a51-b44d-5736211024c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648cf26-0e00-4d95-b995-2185079614cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648cf26-0e00-4d95-b995-2185079614cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724373851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc14faaf-b68e-4102-99c4-dd4a15e7ab54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:04Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:03 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0a94fd-e2f4-4635-9795-a0eeed3bca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0a94fd-e2f4-4635-9795-a0eeed3bca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419c674e-dddd-48af-8338-4b878c2dc20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419c674e-dddd-48af-8338-4b878c2dc20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc14faaf-b68e-4102-99c4-dd4a15e7ab54', 'volume_name': 'volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae82d9af-3e2f-42d4-9d7e-232878149d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae82d9af-3e2f-42d4-9d7e-232878149d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20fd6ca-97df-460a-86f9-f053291a0992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Volume dc14faaf-b68e-4102-99c4-dd4a15e7ab54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54', 'volume_size': 1}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:04 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc 1073741824" returned: 0 in 1.066s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:04 devstack sudo[109915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc
Jun 15 04:36:04 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (0dbc8f7e-3fb5-4584-a6b1-18cf3596630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e218a8-33d3-4532-8f90-94e017e1c029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e218a8-33d3-4532-8f90-94e017e1c029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1697634369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ca1a9d-d093-4e93-9b99-52b306e72d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:04Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65cff26-0dff-4599-b5f6-6e0fd230ff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65cff26-0dff-4599-b5f6-6e0fd230ff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3fab16-5f97-4773-8960-7aa0df74d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3fab16-5f97-4773-8960-7aa0df74d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ca1a9d-d093-4e93-9b99-52b306e72d35', 'volume_name': 'volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a863e8-6e45-411e-8abf-743d7479d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a863e8-6e45-411e-8abf-743d7479d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080fb2d0-3307-4cde-9b83-ab8864e51b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Volume d7ca1a9d-d093-4e93-9b99-52b306e72d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35', 'volume_size': 1}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (7c64baef-5241-4d42-97f3-9f088e431324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b933f2e-03f2-4d1a-98c8-d40c42514562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b933f2e-03f2-4d1a-98c8-d40c42514562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1192582294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04e4536-77b7-4584-bcbf-da956859d371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:05Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa742807-1ade-4c15-9f53-e65d69e4d9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa742807-1ade-4c15-9f53-e65d69e4d9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05dce01-6400-41bf-830a-baf41fa79d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05dce01-6400-41bf-830a-baf41fa79d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04e4536-77b7-4584-bcbf-da956859d371', 'volume_name': 'volume-b04e4536-77b7-4584-bcbf-da956859d371', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f87268b-8784-4895-8338-598513620b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f87268b-8784-4895-8338-598513620b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3102db2e-d982-415f-a220-a807f5574745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Volume b04e4536-77b7-4584-bcbf-da956859d371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04e4536-77b7-4584-bcbf-da956859d371', 'volume_size': 1}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:04 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc" returned: 0 in 0.674s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1280418605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d130f146-12e7-438e-88f0-45c4012a2241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:03Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Creating volume d130f146-12e7-438e-88f0-45c4012a2241 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:04 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:04 devstack sudo[109918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241 1073741824
Jun 15 04:36:04 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee23af3-d9d3-4e90-a1e2-230cc8eea74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b948fa-ef2b-415d-99a5-b368562630ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc (1229e02f-f0c9-41bc-a5a2-11c33d409edc): created successfully
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b948fa-ef2b-415d-99a5-b368562630ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (55c791d9-cdc2-452f-9b42-5d08861fcf25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5111b895-0024-4fd2-8940-06c0031c443b tempest-CreateVolumesFromSnapshotTest-389808047 None] Created volume successfully.
Jun 15 04:36:05 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241 1073741824" returned: 0 in 0.800s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:05 devstack sudo[109924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241
Jun 15 04:36:05 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:06 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241" returned: 0 in 0.620s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.855s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1717980060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04df544e-99bd-4326-ab5b-9adab58e3351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:03Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Creating volume 04df544e-99bd-4326-ab5b-9adab58e3351 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:06 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822d16ad-a5f3-4906-ae44-493e9c1e5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d130f146-12e7-438e-88f0-45c4012a2241', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:06 devstack sudo[109928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351 1073741824
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690349b6-2fe4-41db-b1ef-b8710df7fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:06 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:06 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Volume volume-d130f146-12e7-438e-88f0-45c4012a2241 (d130f146-12e7-438e-88f0-45c4012a2241): created successfully
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690349b6-2fe4-41db-b1ef-b8710df7fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (e923d6b8-ec8f-4a0e-a10e-540918870ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-7905718f-9115-41b7-b9e1-c7e3e101422d tempest-CreateVolumesFromImageTest-1405894155 None] Created volume successfully.
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Flow 'volume_create_manager' (206beed0-4727-47d0-9e19-685ccbdc4058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad8ea1a-e936-4f25-8cf7-69a0b64ba48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad8ea1a-e936-4f25-8cf7-69a0b64ba48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada79815-ee78-4a5f-ac58-26c34c07db08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c750307c545fab87a044d6161ba6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:07Z,use_quota=True,user_id='82e4dad68abc48a7a7ad26cac438515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6d943c-8943-45ce-84ff-48e2d6b4c6d6),volume_type_id=9e6d943c-8943-45ce-84ff-48e2d6b4c6d6)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97415f93-310a-4841-98ea-3cc026ab9a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97415f93-310a-4841-98ea-3cc026ab9a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb057926-1b80-4f25-aa96-201ce5b15e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:36:07 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351 1073741824" returned: 0 in 0.832s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:07 devstack sudo[109935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351
Jun 15 04:36:07 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb057926-1b80-4f25-aa96-201ce5b15e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ada79815-ee78-4a5f-ac58-26c34c07db08', 'volume_name': 'volume-ada79815-ee78-4a5f-ac58-26c34c07db08', 'volume_size': 1, 'image_id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a9f4135ef9e1819f1ef4b0992fff762', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e3c750307c545fab87a044d6161ba6d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2264c3216f2f6fab36a6ca6624135461cf394f96097284b98a29b99f4faa947eb783a5166825e0a8c12f1e3e118d7f2cdd0989c886b1f5b1f6c1836b4d67f1ec', 'id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'created_at': datetime.datetime(2026, 6, 15, 2, 36, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdb76300>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d579060-0980-4305-bc17-3f6c2de5dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d579060-0980-4305-bc17-3f6c2de5dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddb7c9c-4931-4f26-b218-515da4d199b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:07 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Volume ada79815-ee78-4a5f-ac58-26c34c07db08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ada79815-ee78-4a5f-ac58-26c34c07db08', 'volume_size': 1, 'image_id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a9f4135ef9e1819f1ef4b0992fff762', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e3c750307c545fab87a044d6161ba6d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2264c3216f2f6fab36a6ca6624135461cf394f96097284b98a29b99f4faa947eb783a5166825e0a8c12f1e3e118d7f2cdd0989c886b1f5b1f6c1836b4d67f1ec', 'id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'created_at': datetime.datetime(2026, 6, 15, 2, 36, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdb76300>}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Trying to clone ada79815-ee78-4a5f-ac58-26c34c07db08 from image 9cde19e2-785f-4996-8ca9-66e0c3316ae7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:36:07 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2f2d19-97c4-431b-882e-fb70b42cf809]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:07 devstack sudo[109937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD
Jun 15 04:36:07 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:07 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabbbac6-57b3-459a-aa1c-b5a90e986f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5d015c78954aa3acadea250a924cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:04Z,use_quota=True,user_id='47d29c638d5243a99d0cd026c5b52d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Creating volume aabbbac6-57b3-459a-aa1c-b5a90e986f39 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:07 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:07 devstack sudo[109940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 1073741824
Jun 15 04:36:07 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e1b7f1-6de8-4300-b8cf-3a2b10b65981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04df544e-99bd-4326-ab5b-9adab58e3351', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da31645c-544d-4328-a2e2-678dc5dd1b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:07 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Volume volume-04df544e-99bd-4326-ab5b-9adab58e3351 (04df544e-99bd-4326-ab5b-9adab58e3351): created successfully
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da31645c-544d-4328-a2e2-678dc5dd1b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:07 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (31ec9f58-c82f-43e8-82a6-96f739c377fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ea59b256-7a3a-41a3-93a6-c0bca83c6201 tempest-CreateVolumesFromImageTest-1405894155 None] Created volume successfully.
Jun 15 04:36:08 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD" returned: 0 in 0.677s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:08 devstack sudo[109944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD
Jun 15 04:36:08 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:08 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 1073741824" returned: 0 in 0.774s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:08 devstack sudo[109950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39
Jun 15 04:36:08 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:08 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD" returned: 1 in 0.688s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:08 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Temporary image 9cde19e2-785f-4996-8ca9-66e0c3316ae7 is fetched for user 82e4dad68abc48a7a7ad26cac438515d. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f0f58e-323a-436f-a892-7267f079dae1]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:09 devstack sudo[109955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD
Jun 15 04:36:09 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:09 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39" returned: 0 in 0.582s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.194s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724373851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc14faaf-b68e-4102-99c4-dd4a15e7ab54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:04Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Creating volume dc14faaf-b68e-4102-99c4-dd4a15e7ab54 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:09 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ae3cb3-243a-491c-b3f2-4bdf35436228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:09 devstack sudo[109958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 1073741824
Jun 15 04:36:09 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6aefd6-5253-4d45-9d37-514ab6b04d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:09 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Volume volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 (aabbbac6-57b3-459a-aa1c-b5a90e986f39): created successfully
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6aefd6-5253-4d45-9d37-514ab6b04d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Flow 'volume_create_manager' (e4246789-60df-435c-ab55-35fbbbd64d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:09 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e26c72b0-21fd-4ead-9cb0-6f28eb79eef6 tempest-CinderUnicodeTest-1999430980 None] Created volume successfully.
Jun 15 04:36:09 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:09 devstack sudo[109962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD
Jun 15 04:36:09 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:10 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 1073741824" returned: 0 in 0.784s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:10 devstack sudo[109967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54
Jun 15 04:36:10 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:10 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD" returned: 1 in 0.671s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Flow 'volume_create_manager' (f79c3cd0-e4d1-4ddc-81c5-d9e64d7da76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8348a9-65fd-4166-9af2-36ea1f3c2592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8348a9-65fd-4166-9af2-36ea1f3c2592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-561481695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b0ac46-c936-4981-be5e-7826f2d4ebdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5d015c78954aa3acadea250a924cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:11Z,use_quota=True,user_id='47d29c638d5243a99d0cd026c5b52d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5e0f8f-a2a9-4aaf-a533-615fecf005db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5e0f8f-a2a9-4aaf-a533-615fecf005db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22535b0b-191e-42c6-980c-228762ef81fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22535b0b-191e-42c6-980c-228762ef81fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b0ac46-c936-4981-be5e-7826f2d4ebdd', 'volume_name': 'volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86618b94-de49-418c-a547-a0a8c05a6ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86618b94-de49-418c-a547-a0a8c05a6ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:10 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7066df-da71-4fec-9b46-1711f5872c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:10 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Volume e3b0ac46-c936-4981-be5e-7826f2d4ebdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd', 'volume_size': 1}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54" returned: 0 in 0.679s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.287s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1697634369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ca1a9d-d093-4e93-9b99-52b306e72d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:04Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Creating volume d7ca1a9d-d093-4e93-9b99-52b306e72d35 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:10 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20fd6ca-97df-460a-86f9-f053291a0992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:10 devstack sudo[109973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 1073741824
Jun 15 04:36:10 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a554e53-e4cd-4c51-a65a-4e3308546fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:10 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Volume volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 (dc14faaf-b68e-4102-99c4-dd4a15e7ab54): created successfully
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a554e53-e4cd-4c51-a65a-4e3308546fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:10 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (72477fda-df0b-4a51-b44d-5736211024c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:10 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4a1091f0-c59f-4452-a3d7-5a19d802879f tempest-CreateVolumesFromImageTest-1405894155 None] Created volume successfully.
Jun 15 04:36:11 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 1073741824" returned: 0 in 0.783s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:11 devstack sudo[109980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35
Jun 15 04:36:11 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:12 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35" returned: 0 in 0.598s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.386s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1192582294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04e4536-77b7-4584-bcbf-da956859d371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08897d82b894e19965ba9b0124f9e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:05Z,use_quota=True,user_id='817d382ce80340cb9e59be0756878bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Creating volume b04e4536-77b7-4584-bcbf-da956859d371 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:12 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080fb2d0-3307-4cde-9b83-ab8864e51b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:12 devstack sudo[109983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371 1073741824
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31eaa32-7c2f-40ec-912d-29a606ca3b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:12 devstack sudo[109983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:12 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Volume volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 (d7ca1a9d-d093-4e93-9b99-52b306e72d35): created successfully
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31eaa32-7c2f-40ec-912d-29a606ca3b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (0dbc8f7e-3fb5-4584-a6b1-18cf3596630a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:12 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-780369ec-7836-4d31-bb31-bfc11de07861 tempest-CreateVolumesFromImageTest-1405894155 None] Created volume successfully.
Jun 15 04:36:12 devstack sudo[109983]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371 1073741824" returned: 0 in 0.764s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:12 devstack sudo[109988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371
Jun 15 04:36:12 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:13 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371" returned: 0 in 0.600s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.259s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3102db2e-d982-415f-a220-a807f5574745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04e4536-77b7-4584-bcbf-da956859d371', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9912b4f9-740d-400f-96fe-6f62c835cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating offline snapshot c1bc9a47-cb08-452a-b4a4-16a0a1d17755 of volume 1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:36:13 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Volume volume-b04e4536-77b7-4584-bcbf-da956859d371 (b04e4536-77b7-4584-bcbf-da956859d371): created successfully
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9912b4f9-740d-400f-96fe-6f62c835cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Flow 'volume_create_manager' (7c64baef-5241-4d42-97f3-9f088e431324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3aa44-e2c1-4a70-820f-95fe11261fec]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:13 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-829bb03a-d8e0-4327-94fe-425b96ce5fe6 tempest-CreateVolumesFromImageTest-1405894155 None] Created volume successfully.
Jun 15 04:36:13 devstack sudo[109991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc
Jun 15 04:36:13 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:14 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc" returned: 0 in 0.711s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:14 devstack sudo[109996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 1G
Jun 15 04:36:14 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-b04e4536-77b7-4584-bcbf-da956859d371-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-b04e4536-77b7-4584-bcbf-da956859d371-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-quobyte-b04e4536-77b7-4584-bcbf-da956859d371" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-b04e4536-77b7-4584-bcbf-da956859d371" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283c99b-6d4f-445c-a4ea-9c83ee07e8f4]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:14 devstack sudo[109998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371
Jun 15 04:36:14 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:15 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 1G" returned: 0 in 0.785s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:15 devstack sudo[110003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755
Jun 15 04:36:15 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:15 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371" returned: 0 in 0.737s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:15 devstack sudo[110008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371
Jun 15 04:36:15 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:15 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755" returned: 0 in 0.673s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:15 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 is being set with open permissions: ugo+rw
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:15 devstack sudo[110013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755
Jun 15 04:36:15 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:15 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b04e4536-77b7-4584-bcbf-da956859d371" returned: 0 in 0.648s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:15 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-b04e4536-77b7-4584-bcbf-da956859d371" released by "delete_volume" :: held 1.427s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Created reservations ['49f7135f-d54e-43a4-acb0-dd5cc009ff05', 'be931524-82b3-4601-937a-f9f4ac05759b', 'c51bf4f1-8cef-444b-b1a3-ee6c6cb3422d', '403af74e-21fd-4510-80e2-b170144f02f8'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:16 devstack sudo[110016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:16 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:16 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:16 devstack sudo[110019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info
Jun 15 04:36:16 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:16 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Deleted volume successfully.
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-d7ca1a9d-d093-4e93-9b99-52b306e72d35-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-741988f5-2699-4f3c-81d5-f0a5f8b7a494 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-b04e4536-77b7-4584-bcbf-da956859d371-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-d7ca1a9d-d093-4e93-9b99-52b306e72d35-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-quobyte-d7ca1a9d-d093-4e93-9b99-52b306e72d35" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-d7ca1a9d-d093-4e93-9b99-52b306e72d35" acquired by "delete_volume" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ae3a24-ffab-4339-bae1-9e70488b29c9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:16 devstack sudo[110022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35
Jun 15 04:36:16 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:17 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info" returned: 0 in 0.649s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:17 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info is being set with open permissions: ugo+rw
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:17 devstack sudo[110025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info
Jun 15 04:36:17 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:17 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35" returned: 0 in 0.730s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:17 devstack sudo[110030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35
Jun 15 04:36:17 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:17 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.info" returned: 0 in 0.582s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.128s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.320s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada79815-ee78-4a5f-ac58-26c34c07db08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3c750307c545fab87a044d6161ba6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:07Z,use_quota=True,user_id='82e4dad68abc48a7a7ad26cac438515d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6d943c-8943-45ce-84ff-48e2d6b4c6d6),volume_type_id=9e6d943c-8943-45ce-84ff-48e2d6b4c6d6)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Creating volume ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:17 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:17 devstack sudo[110033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 1073741824
Jun 15 04:36:17 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:17 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-fe9da1ef-fbd3-4e34-9842-d5f1dc041c9d tempest-CreateVolumesFromSnapshotTest-389808047 None] Create snapshot completed successfully
Jun 15 04:36:18 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d7ca1a9d-d093-4e93-9b99-52b306e72d35" returned: 0 in 0.619s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-d7ca1a9d-d093-4e93-9b99-52b306e72d35" released by "delete_volume" :: held 1.388s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Created reservations ['fad7c073-6786-4546-a933-7636d4e00afd', '92d52b5c-cdbd-4a28-9145-8a6cb27e7dd7', 'e0e9d0c7-ddb6-4c86-bb31-d7ca4564a334', '48d7b2a4-ae61-4b46-9a6d-0c0417bc29f4'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:18 devstack sudo[110039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:18 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:18 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 1073741824" returned: 0 in 0.807s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:18 devstack sudo[110042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:18 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:18 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.621s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:18 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Deleted volume successfully.
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6b196a84-084e-4895-b8f4-3844d00a0a6b tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-d7ca1a9d-d093-4e93-9b99-52b306e72d35-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-dc14faaf-b68e-4102-99c4-dd4a15e7ab54-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-dc14faaf-b68e-4102-99c4-dd4a15e7ab54-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-quobyte-dc14faaf-b68e-4102-99c4-dd4a15e7ab54" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-dc14faaf-b68e-4102-99c4-dd4a15e7ab54" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5588cea-4db0-4ae5-9dea-18340399f15c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:19 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 0 in 0.676s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.502s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-561481695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b0ac46-c936-4981-be5e-7826f2d4ebdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5d015c78954aa3acadea250a924cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:11Z,use_quota=True,user_id='47d29c638d5243a99d0cd026c5b52d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Creating volume e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:19 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:19 devstack sudo[110046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54
Jun 15 04:36:19 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:19 devstack sudo[110047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd 1073741824
Jun 15 04:36:19 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (4dcc4b6c-bddc-44e8-9fc8-26bdef3aed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42e635f-b4a9-47e2-91f5-11697168b000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Attempting download of 9cde19e2-785f-4996-8ca9-66e0c3316ae7 ((None, [{'url': 'file:///opt/stack/data/glance/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'metadata': {}}])) to volume ada79815-ee78-4a5f-ac58-26c34c07db08. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42e635f-b4a9-47e2-91f5-11697168b000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-869037233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa647c4b-1592-4d2d-b8d9-9b58ebe4b398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:19Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a5ffc1-3315-49e3-a517-08bf8373ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a5ffc1-3315-49e3-a517-08bf8373ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fc9766-5c65-496d-9fcd-12dca24efbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fc9766-5c65-496d-9fcd-12dca24efbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa647c4b-1592-4d2d-b8d9-9b58ebe4b398', 'volume_name': 'volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc813d0-9b8c-48d9-8ca7-47b7079a4cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc813d0-9b8c-48d9-8ca7-47b7079a4cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a993418-11d7-4386-b663-6d91889f3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume aa647c4b-1592-4d2d-b8d9-9b58ebe4b398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398', 'volume_size': 1}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ef052b-d46c-46fa-94d9-3761e08a6f07]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:19 devstack sudo[110050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn
Jun 15 04:36:19 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (89051ca1-f6b3-4abb-8c83-65a06b8c5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9579bed-1968-47a2-b083-fae6bed0857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9579bed-1968-47a2-b083-fae6bed0857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822762443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:20Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c656f6-e1dc-4d3b-a608-41faf70e8adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c656f6-e1dc-4d3b-a608-41faf70e8adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aed709-4ff8-4a7e-bb3c-79c0c8e77823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aed709-4ff8-4a7e-bb3c-79c0c8e77823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb', 'volume_name': 'volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30f1e64-9f1f-47c9-b0cf-35ab9bc77925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30f1e64-9f1f-47c9-b0cf-35ab9bc77925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec78b9b-f264-4c5a-88b4-8b41a7b09268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:19 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb', 'volume_size': 1}
Jun 15 04:36:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:20 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54" returned: 0 in 0.972s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (be2c1a02-65cb-4b4e-97f2-a7313edf3010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:20 devstack sudo[110059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e42a759-93ac-4c76-a927-9478d7dcbea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e42a759-93ac-4c76-a927-9478d7dcbea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002769133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dc2140-270f-4e92-bc6a-563670fb2d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:20Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc31fb14-15f5-4ec4-b50a-abe28cf7fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc31fb14-15f5-4ec4-b50a-abe28cf7fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18713ab6-02a2-4974-9308-b39265f2da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18713ab6-02a2-4974-9308-b39265f2da3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64dc2140-270f-4e92-bc6a-563670fb2d5e', 'volume_name': 'volume-64dc2140-270f-4e92-bc6a-563670fb2d5e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa62064-8147-455d-b846-a64bbd48feed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa62064-8147-455d-b846-a64bbd48feed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf120c19-cb93-4403-a78f-d33d4d8c8432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume 64dc2140-270f-4e92-bc6a-563670fb2d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64dc2140-270f-4e92-bc6a-563670fb2d5e', 'volume_size': 1}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:20 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn" returned: 0 in 0.906s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:20 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd 1073741824" returned: 0 in 1.204s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:20 devstack sudo[110063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn
Jun 15 04:36:20 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:20 devstack sudo[110065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd
Jun 15 04:36:20 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (ca28cdd5-47e2-4e6f-99dc-8fce02a3b357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aab19e-e917-436a-8fde-617935886184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aab19e-e917-436a-8fde-617935886184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1872169633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6efa2eb-4c01-4c6d-8588-71563cd6bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:21Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016bc948-a4df-4507-b8bb-85dcff3cea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016bc948-a4df-4507-b8bb-85dcff3cea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045ebf6-fb3e-43cc-b438-94273dc07def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1045ebf6-fb3e-43cc-b438-94273dc07def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6efa2eb-4c01-4c6d-8588-71563cd6bbf3', 'volume_name': 'volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52991d77-6c56-49a0-bb9c-9e23078e0472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52991d77-6c56-49a0-bb9c-9e23078e0472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0d82d9-250a-4e9e-8975-a364a06e2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:20 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume f6efa2eb-4c01-4c6d-8588-71563cd6bbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3', 'volume_size': 1}
Jun 15 04:36:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (4f4d6a5e-736d-405d-b4db-90fdfed9b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd65e73e-e8ba-4978-a4cf-18e26f7505f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd65e73e-e8ba-4978-a4cf-18e26f7505f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-566361457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899454c4-4b02-412b-8747-1aa760dd62b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:21Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41935681-ce35-469f-976a-935c1f22feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41935681-ce35-469f-976a-935c1f22feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc767b5f-b6cb-450a-b960-a49be186b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc767b5f-b6cb-450a-b960-a49be186b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '899454c4-4b02-412b-8747-1aa760dd62b8', 'volume_name': 'volume-899454c4-4b02-412b-8747-1aa760dd62b8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a74234c-00bf-48f6-84db-f2e7f755537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a74234c-00bf-48f6-84db-f2e7f755537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643214b-8f43-4fb0-9451-ce80160e68d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume 899454c4-4b02-412b-8747-1aa760dd62b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-899454c4-4b02-412b-8747-1aa760dd62b8', 'volume_size': 1}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:21 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-dc14faaf-b68e-4102-99c4-dd4a15e7ab54" returned: 0 in 1.012s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-dc14faaf-b68e-4102-99c4-dd4a15e7ab54" released by "delete_volume" :: held 2.054s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Created reservations ['6734d13c-8528-4ca5-a99a-da104def540d', '85dced22-de3a-4e5b-96d5-c18ec442c3f4', 'e91f511f-fa08-4992-a5f8-2625b5e642df', '77c2eecb-fd33-4f25-a2e7-e2d4dc82dad5'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:21 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn" returned: 1 in 0.894s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cde19e2-785f-4996-8ca9-66e0c3316ae7_ei6bphpn' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf4f2f-44fa-409a-90c1-db9942a15e9d]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:21 devstack sudo[110073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:21 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:21 devstack sudo[110071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD
Jun 15 04:36:21 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:21 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" returned: 0 in 0.897s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-869037233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa647c4b-1592-4d2d-b8d9-9b58ebe4b398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:19Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating volume aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:21 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:21 devstack sudo[110076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 1073741824
Jun 15 04:36:21 devstack sudo[110076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7066df-da71-4fec-9b46-1711f5872c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc6b9dc-2383-491e-8828-b42c0105a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:21 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Volume volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd (e3b0ac46-c936-4981-be5e-7826f2d4ebdd): created successfully
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc6b9dc-2383-491e-8828-b42c0105a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Flow 'volume_create_manager' (f79c3cd0-e4d1-4ddc-81c5-d9e64d7da76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:21 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-794c4223-a2ce-48fb-b3af-4e37b880941f tempest-CinderUnicodeTest-1999430980 None] Created volume successfully.
Jun 15 04:36:21 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.597s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:21 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Deleted volume successfully.
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ff32f77a-c32a-4efe-851c-8640922ec063 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-dc14faaf-b68e-4102-99c4-dd4a15e7ab54-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:21 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:22 devstack sudo[110081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD
Jun 15 04:36:22 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:22 devstack sudo[110076]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 1073741824" returned: 0 in 0.834s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:22 devstack sudo[110086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398
Jun 15 04:36:22 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-04df544e-99bd-4326-ab5b-9adab58e3351-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-04df544e-99bd-4326-ab5b-9adab58e3351-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-quobyte-04df544e-99bd-4326-ab5b-9adab58e3351" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-04df544e-99bd-4326-ab5b-9adab58e3351" acquired by "delete_volume" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[86274ed5-2da0-45ba-96eb-accfb4568ff5]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:22 devstack sudo[110088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351
Jun 15 04:36:22 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:22 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] 9cde19e2-785f-4996-8ca9-66e0c3316ae7 was raw, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:22 devstack sudo[110093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:22 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:23 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398" returned: 0 in 0.687s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822762443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:20Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating volume a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:23 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a993418-11d7-4386-b663-6d91889f3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:23 devstack sudo[110096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb 1073741824
Jun 15 04:36:23 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7916c22a-fae5-4d1a-93d5-f35444190eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:23 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 (aa647c4b-1592-4d2d-b8d9-9b58ebe4b398): created successfully
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7916c22a-fae5-4d1a-93d5-f35444190eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (4dcc4b6c-bddc-44e8-9fc8-26bdef3aed31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e9b9d032-ac22-4cb2-9dfe-778b1ee0657b tempest-CreateVolumesFromSnapshotTest-389808047 None] Created volume successfully.
Jun 15 04:36:23 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351" returned: 0 in 0.826s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:23 devstack sudo[110104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351
Jun 15 04:36:23 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:23 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 0 in 0.802s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9cde19e2-785f-4996-8ca9-66e0c3316ae7__vuy55iodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:36:23 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:23 devstack sudo[110106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 1G
Jun 15 04:36:23 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:23 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb 1073741824" returned: 0 in 0.797s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:23 devstack sudo[110112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb
Jun 15 04:36:23 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:24 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-04df544e-99bd-4326-ab5b-9adab58e3351" returned: 0 in 0.639s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-04df544e-99bd-4326-ab5b-9adab58e3351" released by "delete_volume" :: held 1.516s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Created reservations ['6c584e04-2d87-4d42-b2d5-de6f31bd633c', '3496df72-f6b7-49cc-9dc5-5c9744a3f472', '08d8e712-46a2-451e-8044-fc9ec404d89f', '74874cd2-8873-4ff9-a39a-23ff41087609'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:24 devstack sudo[110118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:24 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:24 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 1G" returned: 0 in 0.714s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3fdc44-79be-4b18-8447-6030dfe65345]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:24 devstack sudo[110120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:24 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:24 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb" returned: 0 in 0.614s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.199s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002769133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dc2140-270f-4e92-bc6a-563670fb2d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:20Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating volume 64dc2140-270f-4e92-bc6a-563670fb2d5e {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:24 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec78b9b-f264-4c5a-88b4-8b41a7b09268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:24 devstack sudo[110123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e 1073741824
Jun 15 04:36:24 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e517dce-4461-4704-a37d-a223498ff304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:24 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb (a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb): created successfully
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e517dce-4461-4704-a37d-a223498ff304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (89051ca1-f6b3-4abb-8c83-65a06b8c5d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-596f9e1e-1432-4a1c-af44-e65d236ee152 tempest-CreateVolumesFromSnapshotTest-389808047 None] Created volume successfully.
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-d130f146-12e7-438e-88f0-45c4012a2241-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-d130f146-12e7-438e-88f0-45c4012a2241-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "cinder-quobyte-d130f146-12e7-438e-88f0-45c4012a2241" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-d130f146-12e7-438e-88f0-45c4012a2241" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3967cb-439c-4489-b460-48cd5221f2c1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:24 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.692s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:24 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Deleted volume successfully.
Jun 15 04:36:24 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-a86fd141-bdec-41a9-88ee-23f14f367bc2 tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-04df544e-99bd-4326-ab5b-9adab58e3351-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:24 devstack sudo[110126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241
Jun 15 04:36:24 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:25 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 0 in 0.806s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:25 devstack sudo[110133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:25 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:25 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e 1073741824" returned: 0 in 0.825s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:25 devstack sudo[110135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e
Jun 15 04:36:25 devstack sudo[110135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:25 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241" returned: 0 in 0.793s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:25 devstack sudo[110140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241
Jun 15 04:36:25 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:25 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 1 in 0.772s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Downloaded image 9cde19e2-785f-4996-8ca9-66e0c3316ae7 ((None, [{'url': 'file:///opt/stack/data/glance/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'metadata': {}}])) to volume ada79815-ee78-4a5f-ac58-26c34c07db08 successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Temporary image 9cde19e2-785f-4996-8ca9-66e0c3316ae7 for user 82e4dad68abc48a7a7ad26cac438515d is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Marking volume ada79815-ee78-4a5f-ac58-26c34c07db08 as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Copying metadata from image 9cde19e2-785f-4996-8ca9-66e0c3316ae7 to ada79815-ee78-4a5f-ac58-26c34c07db08. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Creating volume glance metadata for volume ada79815-ee78-4a5f-ac58-26c34c07db08 backed by image 9cde19e2-785f-4996-8ca9-66e0c3316ae7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a9f4135ef9e1819f1ef4b0992fff762', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddb7c9c-4931-4f26-b218-515da4d199b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada79815-ee78-4a5f-ac58-26c34c07db08', 'volume_size': 1, 'image_id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a9f4135ef9e1819f1ef4b0992fff762', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e3c750307c545fab87a044d6161ba6d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2264c3216f2f6fab36a6ca6624135461cf394f96097284b98a29b99f4faa947eb783a5166825e0a8c12f1e3e118d7f2cdd0989c886b1f5b1f6c1836b4d67f1ec', 'id': '9cde19e2-785f-4996-8ca9-66e0c3316ae7', 'created_at': datetime.datetime(2026, 6, 15, 2, 36, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cde19e2-785f-4996-8ca9-66e0c3316ae7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdb76300>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ffc359-7476-40dc-9b0a-04aff646d6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:25 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Volume volume-ada79815-ee78-4a5f-ac58-26c34c07db08 (ada79815-ee78-4a5f-ac58-26c34c07db08): created successfully
Jun 15 04:36:25 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ffc359-7476-40dc-9b0a-04aff646d6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Flow 'volume_create_manager' (206beed0-4727-47d0-9e19-685ccbdc4058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:26 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-66b81b4a-79ed-49c5-b92a-c55676c258d5 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Created volume successfully.
Jun 15 04:36:26 devstack sudo[110135]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e" returned: 0 in 0.685s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.330s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1872169633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6efa2eb-4c01-4c6d-8588-71563cd6bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:21Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating volume f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:26 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:26 devstack sudo[110146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 1073741824
Jun 15 04:36:26 devstack sudo[110146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf120c19-cb93-4403-a78f-d33d4d8c8432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64dc2140-270f-4e92-bc6a-563670fb2d5e', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4899b11-bb1c-48ed-b0a8-5a8a3ce4295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:26 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume volume-64dc2140-270f-4e92-bc6a-563670fb2d5e (64dc2140-270f-4e92-bc6a-563670fb2d5e): created successfully
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4899b11-bb1c-48ed-b0a8-5a8a3ce4295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (be2c1a02-65cb-4b4e-97f2-a7313edf3010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:26 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-893114f9-4447-489e-bd85-e73ce1e8011e tempest-CreateVolumesFromSnapshotTest-389808047 None] Created volume successfully.
Jun 15 04:36:26 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d130f146-12e7-438e-88f0-45c4012a2241" returned: 0 in 0.655s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-quobyte-d130f146-12e7-438e-88f0-45c4012a2241" released by "delete_volume" :: held 1.511s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Created reservations ['0998e91c-bbd7-4f66-b41b-5d43985f2f67', 'eba9ff7f-15f4-4697-9a29-d1025cc55ddb', '52417e3a-6a4d-428b-90c1-7f877e15ea33', '658a5d70-3c8a-4173-862f-7ae92a7356c0'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:26 devstack sudo[110151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:26 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Acquiring lock "cinder-ada79815-ee78-4a5f-ac58-26c34c07db08-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "cinder-ada79815-ee78-4a5f-ac58-26c34c07db08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Acquiring lock "cinder-quobyte-ada79815-ee78-4a5f-ac58-26c34c07db08" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "cinder-quobyte-ada79815-ee78-4a5f-ac58-26c34c07db08" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118fdea-3484-4763-9b2a-91392739c08f]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:26 devstack sudo[110159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:26 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:26 devstack sudo[110146]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 1073741824" returned: 0 in 0.883s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:26 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:27 devstack sudo[110165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3
Jun 15 04:36:27 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:27 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.768s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:27 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Deleted volume successfully.
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-676140d5-9c25-4d7e-993d-82034a55f25d tempest-CreateVolumesFromImageTest-1405894155 None] Lock "cinder-d130f146-12e7-438e-88f0-45c4012a2241-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:27 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 0 in 0.863s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:27 devstack sudo[110170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:27 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:27 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3" returned: 0 in 0.751s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.658s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-566361457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899454c4-4b02-412b-8747-1aa760dd62b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4bff6015f248b09002070265b4d2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:21Z,use_quota=True,user_id='1421fe51bbc84314b3b224279efd1153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Creating volume 899454c4-4b02-412b-8747-1aa760dd62b8 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:27 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:27 devstack sudo[110173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8 1073741824
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0d82d9-250a-4e9e-8975-a364a06e2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:27 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0039091-0da5-42ee-82fe-4d7a93f7ba7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:27 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 (f6efa2eb-4c01-4c6d-8588-71563cd6bbf3): created successfully
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0039091-0da5-42ee-82fe-4d7a93f7ba7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:27 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (ca28cdd5-47e2-4e6f-99dc-8fce02a3b357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:27 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-20beb2a7-b196-45eb-9102-9f67844efae6 tempest-CreateVolumesFromSnapshotTest-389808047 None] Created volume successfully.
Jun 15 04:36:28 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 1 in 0.860s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:28 devstack sudo[110182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08
Jun 15 04:36:28 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:28 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8 1073741824" returned: 0 in 0.951s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:28 devstack sudo[110185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8
Jun 15 04:36:28 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:29 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ada79815-ee78-4a5f-ac58-26c34c07db08" returned: 0 in 0.659s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "cinder-quobyte-ada79815-ee78-4a5f-ac58-26c34c07db08" released by "delete_volume" :: held 2.454s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Created reservations ['050e9b0c-faba-455d-9119-79f54f991fa8', 'e93290e2-4bd2-43c1-83ba-d1a6995791ce', '738c7aa4-9d8a-48f3-908c-62f1eff4b1d6', '78e013a7-788b-4042-be03-e14aca4fc617'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:29 devstack sudo[110188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:29 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:29 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8" returned: 0 in 0.689s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.686s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643214b-8f43-4fb0-9451-ce80160e68d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-899454c4-4b02-412b-8747-1aa760dd62b8', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7eb8dcd-b68e-4996-acfa-78d758e2786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Creating offline snapshot 82909d89-db2c-4994-b1da-bda04ba94b97 of volume e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:36:29 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Volume volume-899454c4-4b02-412b-8747-1aa760dd62b8 (899454c4-4b02-412b-8747-1aa760dd62b8): created successfully
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7eb8dcd-b68e-4996-acfa-78d758e2786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Flow 'volume_create_manager' (4f4d6a5e-736d-405d-b4db-90fdfed9b93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[33247f17-e001-44f4-8c45-99cb2ff76085]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ac689ac9-e07e-420a-9432-98063ebff962 tempest-CreateVolumesFromSnapshotTest-389808047 None] Created volume successfully.
Jun 15 04:36:29 devstack sudo[110191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd
Jun 15 04:36:29 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:29 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.650s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:29 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Deleted volume successfully.
Jun 15 04:36:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db76ea5f-b80e-4546-8978-94df9a95c9e2 tempest-VolumeAndVolumeTypeFromImageTest-1780697000 None] Lock "cinder-ada79815-ee78-4a5f-ac58-26c34c07db08-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-899454c4-4b02-412b-8747-1aa760dd62b8-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-899454c4-4b02-412b-8747-1aa760dd62b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-899454c4-4b02-412b-8747-1aa760dd62b8" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-899454c4-4b02-412b-8747-1aa760dd62b8" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f475c2-1be3-49e5-a1be-1493671f9808]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:30 devstack sudo[110194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8
Jun 15 04:36:30 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:30 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" returned: 0 in 0.953s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:30 devstack sudo[110200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 1G
Jun 15 04:36:30 devstack sudo[110200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:31 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8" returned: 0 in 0.837s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:31 devstack sudo[110207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8
Jun 15 04:36:31 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:31 devstack sudo[110200]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 1G" returned: 0 in 1.067s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:31 devstack sudo[110213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97
Jun 15 04:36:31 devstack sudo[110213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:31 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-899454c4-4b02-412b-8747-1aa760dd62b8" returned: 0 in 0.727s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-899454c4-4b02-412b-8747-1aa760dd62b8" released by "delete_volume" :: held 1.620s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['abfda4c5-094b-49bd-856e-702546fcfbd8', '0ad14c3b-8820-4f70-af86-0cf43e8cfdff', '4e1fd7a4-8cae-40a2-ad64-38271d63ed31', '8d2ad599-5a77-416c-8846-f44e8654f02b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:32 devstack sudo[110216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:32 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:32 devstack sudo[110213]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97" returned: 0 in 0.933s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:32 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 is being set with open permissions: ugo+rw
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:32 devstack sudo[110222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97
Jun 15 04:36:32 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9fb1d5-1c28-4b20-85c6-ce27fa9621d9]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:32 devstack sudo[110224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3
Jun 15 04:36:32 devstack sudo[110224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:32 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.885s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:32 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleted volume successfully.
Jun 15 04:36:32 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-20e4f3f3-5e5c-4448-aef6-325189163154 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-899454c4-4b02-412b-8747-1aa760dd62b8-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:33 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97" returned: 0 in 0.899s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:33 devstack sudo[110229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info
Jun 15 04:36:33 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Flow 'volume_create_manager' (ede2795f-563e-4954-ab1b-75a2fe16079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99670f9a-43ff-408c-a7cf-ea356ba68bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99670f9a-43ff-408c-a7cf-ea356ba68bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dc134f-57c7-47a9-b9d7-240d1392f59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a55c89f8cdcb443f9242ec14c762ea67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:34Z,use_quota=True,user_id='095c8395015d4e2e90f70d2cbb8c9aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebd912f-33f1-4fb3-b1c9-dfeb6dac4672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebd912f-33f1-4fb3-b1c9-dfeb6dac4672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:33 devstack sudo[110224]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e340e86-ab85-4ab5-ace0-d97df97d25d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.image.glance [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Creating Keystone auth plugin from conf {{(pid=92103) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3" returned: 0 in 1.050s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:33 devstack sudo[110233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3
Jun 15 04:36:33 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:33 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e340e86-ab85-4ab5-ace0-d97df97d25d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94dc134f-57c7-47a9-b9d7-240d1392f59c', 'volume_name': 'volume-94dc134f-57c7-47a9-b9d7-240d1392f59c', 'volume_size': 1, 'image_id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '506e67913bfc56a273226c6463bf21ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a55c89f8cdcb443f9242ec14c762ea67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4be1fd00b23097cdf1f03e1bb2606dd777c59fed51cccfa1f2d528a3d942cb0879b995cb55f291e13d032ae458f2eebd1cb322e8ca437a2c1774286d641f0b8', 'id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'created_at': datetime.datetime(2026, 6, 15, 2, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdc13320>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c289fa8-3ec1-4814-bee7-02a3908c8274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c289fa8-3ec1-4814-bee7-02a3908c8274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e877c381-fd22-4365-ab9f-92cb045b7e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:34 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Volume 94dc134f-57c7-47a9-b9d7-240d1392f59c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94dc134f-57c7-47a9-b9d7-240d1392f59c', 'volume_size': 1, 'image_id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '506e67913bfc56a273226c6463bf21ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a55c89f8cdcb443f9242ec14c762ea67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4be1fd00b23097cdf1f03e1bb2606dd777c59fed51cccfa1f2d528a3d942cb0879b995cb55f291e13d032ae458f2eebd1cb322e8ca437a2c1774286d641f0b8', 'id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'created_at': datetime.datetime(2026, 6, 15, 2, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdc13320>}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Trying to clone 94dc134f-57c7-47a9-b9d7-240d1392f59c from image b170cd32-bc47-46b9-a1c8-e30710aef8b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'metadata': {}}]). {{(pid=92103) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 04:36:34 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 04:36:34 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a4a35-f7d2-4e10-82c2-8a54a1b4ffec]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info" returned: 0 in 0.766s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:34 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info is being set with open permissions: ugo+rw
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:34 devstack sudo[110238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info
Jun 15 04:36:34 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:34 devstack sudo[110236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD
Jun 15 04:36:34 devstack sudo[110236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:34 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3" returned: 0 in 0.700s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3" released by "delete_volume" :: held 1.803s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['94564c4b-22f4-45bf-ac2f-736b6264c109', 'e5a462fb-6afc-45ab-bc70-873a5ef794e5', 'b88e087b-f6f7-4cda-9254-085ad507b7b0', 'c05e2ee9-a403-42ad-889c-4c648d1fbe47'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:34 devstack sudo[110241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:34 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-64dc2140-270f-4e92-bc6a-563670fb2d5e-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-64dc2140-270f-4e92-bc6a-563670fb2d5e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-64dc2140-270f-4e92-bc6a-563670fb2d5e" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-64dc2140-270f-4e92-bc6a-563670fb2d5e" acquired by "delete_volume" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db06a98-3ab1-415c-883f-297e3fa6385c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:35 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.info" returned: 0 in 0.833s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:35 devstack sudo[110236]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.593s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:35 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5c76c164-e49f-4d54-bd2c-2ec3a6bb715c tempest-CinderUnicodeTest-1999430980 None] Create snapshot completed successfully
Jun 15 04:36:35 devstack sudo[110246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e
Jun 15 04:36:35 devstack sudo[110246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:35 devstack sudo[110247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD
Jun 15 04:36:35 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Flow 'volume_create_manager' (10c54041-5f81-42e3-acf3-e6974467ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabf48c1-bcf3-46f6-9864-0a8b9fbd2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabf48c1-bcf3-46f6-9864-0a8b9fbd2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-965143424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b4c424-dab4-45aa-95c5-38c959cbee50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d97bf4853c45a0b57d6d755054d5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:35Z,use_quota=True,user_id='0ce096036fd348b78ea1a65f6a2d5143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:35 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10bc6b4-6ccf-4daf-9ee7-724a091c5533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10bc6b4-6ccf-4daf-9ee7-724a091c5533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120492c5-d89f-4b8f-8518-c0117da0a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120492c5-d89f-4b8f-8518-c0117da0a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b4c424-dab4-45aa-95c5-38c959cbee50', 'volume_name': 'volume-b5b4c424-dab4-45aa-95c5-38c959cbee50', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471b9fb-81a5-4e8e-b88a-22c68fbf4308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471b9fb-81a5-4e8e-b88a-22c68fbf4308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dedcd1-eaf4-455f-81ac-5fc77d483d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:35 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Volume b5b4c424-dab4-45aa-95c5-38c959cbee50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b4c424-dab4-45aa-95c5-38c959cbee50', 'volume_size': 1}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-965143424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b4c424-dab4-45aa-95c5-38c959cbee50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d97bf4853c45a0b57d6d755054d5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:35Z,use_quota=True,user_id='0ce096036fd348b78ea1a65f6a2d5143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Creating volume b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:35 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.920s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-82909d89-db2c-4994-b1da-bda04ba94b97-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:35 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleted volume successfully.
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:35 devstack sudo[110251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 1073741824
Jun 15 04:36:35 devstack sudo[110251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-82909d89-db2c-4994-b1da-bda04ba94b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-quobyte-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:35 devstack sudo[110253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-006b8740-39f9-442b-8fab-dc10e68e8feb tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-f6efa2eb-4c01-4c6d-8588-71563cd6bbf3-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:35 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-quobyte-82909d89-db2c-4994-b1da-bda04ba94b97" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-82909d89-db2c-4994-b1da-bda04ba94b97" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Deleting offline snapshot 82909d89-db2c-4994-b1da-bda04ba94b97 of volume e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] snapshot_file for this snap is: volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7c2930-dd3d-410c-adb1-d973b16bfe72]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:35 devstack sudo[110255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97
Jun 15 04:36:35 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:35 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD" returned: 1 in 0.908s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:35 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Temporary image b170cd32-bc47-46b9-a1c8-e30710aef8b7 is fetched for user 095c8395015d4e2e90f70d2cbb8c9aae. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 04:36:36 devstack sudo[110246]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e" returned: 0 in 1.065s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:36 devstack sudo[110263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e
Jun 15 04:36:36 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b4631-f470-4532-a0d6-e390aeea2488]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:36 devstack sudo[110265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD
Jun 15 04:36:36 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:36 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.735s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:36:36 devstack sudo[110251]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 1073741824" returned: 0 in 1.117s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:36 devstack sudo[110275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:36:36 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:36 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97" returned: 0 in 0.972s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d9954a-b0fa-4eda-baeb-f4fbfcf2796d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:36 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-64dc2140-270f-4e92-bc6a-563670fb2d5e" returned: 0 in 0.708s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-64dc2140-270f-4e92-bc6a-563670fb2d5e" released by "delete_volume" :: held 1.859s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:36 devstack sudo[110278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd
Jun 15 04:36:36 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['bcc23ddf-85a0-4305-9cdc-d46c1cd09b2e', '59b75b05-4d6d-4876-8f49-502124daa811', '15a91786-c7f4-44ba-9eb5-f98759f2ac37', 'a4272fc1-4fc4-40c0-a2ff-ab5a33bdaa45'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:36 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:36 devstack sudo[110282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:36 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:37 devstack sudo[110284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD
Jun 15 04:36:37 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:37 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 0.686s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dedcd1-eaf4-455f-81ac-5fc77d483d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b4c424-dab4-45aa-95c5-38c959cbee50', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c1d9bb-880b-4c3a-ba96-cf8e99e67a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb" acquired by "delete_volume" :: waited 0.045s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:37 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Volume volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 (b5b4c424-dab4-45aa-95c5-38c959cbee50): created successfully
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c1d9bb-880b-4c3a-ba96-cf8e99e67a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Flow 'volume_create_manager' (10c54041-5f81-42e3-acf3-e6974467ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[9990a55a-2420-4c93-9062-a0dd745d821e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-49668754-d09c-4d19-b719-f4e6928eda9a tempest-VolumeDependencyTests-1470179986 None] Created volume successfully.
Jun 15 04:36:37 devstack sudo[110287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb
Jun 15 04:36:37 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:37 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" returned: 0 in 0.969s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:37 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.765s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:37 devstack sudo[110293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97
Jun 15 04:36:37 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleted volume successfully.
Jun 15 04:36:37 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d09b1f1c-657d-4126-afa0-a896f3105229 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-64dc2140-270f-4e92-bc6a-563670fb2d5e-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:37 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD" returned: 1 in 0.901s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dc134f-57c7-47a9-b9d7-240d1392f59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a55c89f8cdcb443f9242ec14c762ea67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:34Z,use_quota=True,user_id='095c8395015d4e2e90f70d2cbb8c9aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Creating volume 94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:37 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:37 devstack sudo[110298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c 1073741824
Jun 15 04:36:37 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:38 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb" returned: 0 in 0.791s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:38 devstack sudo[110306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb
Jun 15 04:36:38 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:38 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97" returned: 0 in 0.727s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:38 devstack sudo[110310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97
Jun 15 04:36:38 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:38 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c 1073741824" returned: 0 in 0.873s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:38 devstack sudo[110314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:38 devstack sudo[110314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:38 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb" returned: 0 in 0.696s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb" released by "delete_volume" :: held 1.582s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:38 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['cdeea028-4923-44bd-88f2-5da35a0d654b', '471fa7f2-fb7a-44f4-ac15-3973b2b7dd42', '4921d88f-5a07-4755-89fb-bed1ca6c003d', '1db5b5e7-4b0b-4213-b120-1726999f4164'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:39 devstack sudo[110318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:39 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:39 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd.82909d89-db2c-4994-b1da-bda04ba94b97" returned: 0 in 0.726s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-82909d89-db2c-4994-b1da-bda04ba94b97" released by "_delete_snapshot" :: held 3.539s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" released by "delete_snapshot" :: held 3.578s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Created reservations ['9688e2e8-6941-4271-b25f-b06c8773e3a2', 'a11e56b9-6050-4f8d-a7ba-408010fc2530', '30fd07f3-1f76-4444-a321-3cb76dd2d0fc', '8de342f3-282c-4ce7-9b88-6a732867a41f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:39 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Delete snapshot completed successfully.
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-22f1ad28-1f17-41ee-a310-bf29d4656ba5 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-82909d89-db2c-4994-b1da-bda04ba94b97-delete_snapshot" released by "delete_snapshot" :: held 3.729s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:39 devstack sudo[110314]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 0 in 0.636s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.613s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Creating offline snapshot 93b729aa-3e6b-4de8-9926-aca47e29ce08 of volume b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Attempting download of b170cd32-bc47-46b9-a1c8-e30710aef8b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'metadata': {}}])) to volume 94dc134f-57c7-47a9-b9d7-240d1392f59c. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a63b12-5c8b-4dc6-b521-bb5ba1365ded]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c87322-21df-4825-902e-9d3e74abbe1e]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:39 devstack sudo[110321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:36:39 devstack sudo[110321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a365d-12b7-46d3-a9d2-d9b7852e639b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:39 devstack sudo[110322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8
Jun 15 04:36:39 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-e3b0ac46-c936-4981-be5e-7826f2d4ebdd-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-e3b0ac46-c936-4981-be5e-7826f2d4ebdd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:39 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.752s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:39 devstack sudo[110325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398
Jun 15 04:36:39 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:39 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleted volume successfully.
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d203bcee-5f64-4d39-9d44-fa791b2baa0c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-a2997e0a-3a03-4ea4-a3c7-2dbc8cb6dfbb-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-quobyte-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353bdbe-02a9-4627-b1dc-33fb5c03cafb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:39 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:40 devstack sudo[110328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd
Jun 15 04:36:40 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:40 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8" returned: 0 in 0.779s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:40 devstack sudo[110321]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 0.969s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:40 devstack sudo[110336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8
Jun 15 04:36:40 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:40 devstack sudo[110342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 1G
Jun 15 04:36:40 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:40 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398" returned: 0 in 0.907s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:40 devstack sudo[110344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398
Jun 15 04:36:40 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:40 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" returned: 0 in 0.978s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:40 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:40 devstack sudo[110351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd
Jun 15 04:36:40 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:41 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8" returned: 1 in 0.746s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b170cd32-bc47-46b9-a1c8-e30710aef8b7_lwv_51s8' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31cb86-028c-42ad-835b-80775fcbecab]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:41 devstack sudo[110358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD
Jun 15 04:36:41 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:41 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398" returned: 0 in 0.701s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:41 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398" released by "delete_volume" :: held 1.664s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 1G" returned: 0 in 0.837s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:41 devstack sudo[110362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08
Jun 15 04:36:41 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['d9f4c2be-4649-4fa0-b0e2-772b479f1cb0', '99cfb6c5-76e6-4e06-82e8-8bb772c3c923', '3755d383-0ba5-401d-a146-9daf6f56b0ce', '9eb117f3-fa28-4f45-90c1-262f6ff3da50'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:41 devstack sudo[110364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:41 devstack sudo[110364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:41 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" returned: 0 in 0.714s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-e3b0ac46-c936-4981-be5e-7826f2d4ebdd" released by "delete_volume" :: held 1.759s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Created reservations ['20dd0cf0-52a2-4589-b6fd-365220ec4a86', 'e68a0380-a772-4e56-b7d8-b3c7ac5a8530', 'f6dc6b7b-8bd7-4eaa-b26a-4abaab72f370', '156fbba9-7367-4d24-ba01-852e1a043d27'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-c1bc9a47-cb08-452a-b4a4-16a0a1d17755-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:41 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-c1bc9a47-cb08-452a-b4a4-16a0a1d17755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-1229e02f-f0c9-41bc-a5a2-11c33d409edc" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:41 devstack sudo[110369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:41 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-1229e02f-f0c9-41bc-a5a2-11c33d409edc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-c1bc9a47-cb08-452a-b4a4-16a0a1d17755" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-c1bc9a47-cb08-452a-b4a4-16a0a1d17755" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleting offline snapshot c1bc9a47-cb08-452a-b4a4-16a0a1d17755 of volume 1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] snapshot_file for this snap is: volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[404cdd89-120e-4d23-a76a-5d4d48edf17e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:41 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:42 devstack sudo[110370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD
Jun 15 04:36:42 devstack sudo[110370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:42 devstack sudo[110376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755
Jun 15 04:36:42 devstack sudo[110376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-aabbbac6-57b3-459a-aa1c-b5a90e986f39-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-aabbbac6-57b3-459a-aa1c-b5a90e986f39-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "cinder-quobyte-aabbbac6-57b3-459a-aa1c-b5a90e986f39" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:42 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08" returned: 0 in 0.995s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:42 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 is being set with open permissions: ugo+rw
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:42 devstack sudo[110380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08
Jun 15 04:36:42 devstack sudo[110380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-aabbbac6-57b3-459a-aa1c-b5a90e986f39" acquired by "delete_volume" :: waited 0.059s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60da89-a7e2-48be-aa29-4860b197a99a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:42 devstack sudo[110364]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.985s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleted volume successfully.
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ad7b3e48-b472-44a0-9f4e-0c554c7d4d98 tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-aa647c4b-1592-4d2d-b8d9-9b58ebe4b398-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:42 devstack sudo[110382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39
Jun 15 04:36:42 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:42 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.002s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:42 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Deleted volume successfully.
Jun 15 04:36:42 devstack sudo[110370]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD" returned: 1 in 1.006s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] b170cd32-bc47-46b9-a1c8-e30710aef8b7 was raw, converting to raw {{(pid=92103) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:42 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-af98eb92-0f7a-47dc-b777-e9e57d752b64 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-e3b0ac46-c936-4981-be5e-7826f2d4ebdd-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:42 devstack sudo[110391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:42 devstack sudo[110391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:43 devstack sudo[110380]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08" returned: 0 in 0.753s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:43 devstack sudo[110376]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755" returned: 0 in 1.081s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:36:43 devstack sudo[110394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info
Jun 15 04:36:43 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[76963c1c-4d02-4f2d-9148-548276b4ae0d]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:43 devstack sudo[110396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc
Jun 15 04:36:43 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:43 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39" returned: 0 in 1.081s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:43 devstack sudo[110403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39
Jun 15 04:36:43 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:43 devstack sudo[110391]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 0 in 0.741s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b170cd32-bc47-46b9-a1c8-e30710aef8b7_ygw1s30rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:36:43 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:43 devstack sudo[110407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c 1G
Jun 15 04:36:43 devstack sudo[110407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:43 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:43 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info is being set with open permissions: ugo+rw
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:43 devstack sudo[110409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info
Jun 15 04:36:43 devstack sudo[110409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:43 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc" returned: 0 in 0.838s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:43 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:43 devstack sudo[110416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755
Jun 15 04:36:43 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:44 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-aabbbac6-57b3-459a-aa1c-b5a90e986f39" returned: 0 in 0.700s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-quobyte-aabbbac6-57b3-459a-aa1c-b5a90e986f39" released by "delete_volume" :: held 1.844s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Created reservations ['aad173ae-7b5f-4f8d-942f-057f12ab74db', 'd7b90d12-03f3-4747-be1d-4221689db02d', '0088c7a0-4140-4738-ae0e-73fb759af9e5', 'a534fa22-7cdc-4f7f-9da2-cb092b13de1c'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:44 devstack sudo[110407]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c 1G" returned: 0 in 0.700s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:44 devstack sudo[110423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:44 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:44 devstack sudo[110409]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.info" returned: 0 in 0.656s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.993s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90c40b-77ed-44c8-a323-9bf2595404ea]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:44 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-03d8c597-fee6-41f6-8e69-52fbccb561d9 tempest-VolumeDependencyTests-1470179986 None] Create snapshot completed successfully
Jun 15 04:36:44 devstack sudo[110425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:44 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:44 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755" returned: 0 in 0.846s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:44 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:44 devstack sudo[110432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755
Jun 15 04:36:44 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:45 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.760s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:45 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Deleted volume successfully.
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-5ac0dec3-d865-44b8-bf91-f3fcee33f3a4 tempest-CinderUnicodeTest-1999430980 None] Lock "cinder-aabbbac6-57b3-459a-aa1c-b5a90e986f39-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:45 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 0 in 0.875s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:45 devstack sudo[110437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:45 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:45 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc.c1bc9a47-cb08-452a-b4a4-16a0a1d17755" returned: 0 in 0.883s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Flow 'volume_create_manager' (c8d7c116-ee68-452d-8b87-192c4494548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683768a1-2ead-45bf-902c-16c06a654a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-c1bc9a47-cb08-452a-b4a4-16a0a1d17755" released by "_delete_snapshot" :: held 3.833s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683768a1-2ead-45bf-902c-16c06a654a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1390560138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75eb266-8813-4719-a512-24d0e57aa132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d97bf4853c45a0b57d6d755054d5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93b729aa-3e6b-4de8-9926-aca47e29ce08,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:46Z,use_quota=True,user_id='0ce096036fd348b78ea1a65f6a2d5143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098b49cc-9cbb-44e2-bb42-669f2bd13c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098b49cc-9cbb-44e2-bb42-669f2bd13c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6676cffc-44d9-4567-a935-6a896a546904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6676cffc-44d9-4567-a935-6a896a546904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd75eb266-8813-4719-a512-24d0e57aa132', 'volume_name': 'volume-d75eb266-8813-4719-a512-24d0e57aa132', 'volume_size': 1, 'snapshot_id': '93b729aa-3e6b-4de8-9926-aca47e29ce08'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423c3c3e-b6bf-47ef-89cf-59455acd0d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423c3c3e-b6bf-47ef-89cf-59455acd0d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c6554e-81c4-4960-b81d-23cb1afed8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:45 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Volume d75eb266-8813-4719-a512-24d0e57aa132: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d75eb266-8813-4719-a512-24d0e57aa132', 'volume_size': 1, 'snapshot_id': '93b729aa-3e6b-4de8-9926-aca47e29ce08'}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-1229e02f-f0c9-41bc-a5a2-11c33d409edc" released by "delete_snapshot" :: held 3.925s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-quobyte-93b729aa-3e6b-4de8-9926-aca47e29ce08-d75eb266-8813-4719-a512-24d0e57aa132" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-93b729aa-3e6b-4de8-9926-aca47e29ce08-d75eb266-8813-4719-a512-24d0e57aa132" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Creating volume d75eb266-8813-4719-a512-24d0e57aa132 from snapshot 93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-quobyte-d75eb266-8813-4719-a512-24d0e57aa132" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-d75eb266-8813-4719-a512-24d0e57aa132" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] snapshot: 93b729aa-3e6b-4de8-9926-aca47e29ce08, volume: d75eb266-8813-4719-a512-24d0e57aa132,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['459d1c8d-3e12-4bd7-8489-084d944b3bcf', '128b412f-42d4-4821-8a16-28347decbd21', 'f20f4278-e890-42d9-a3ca-a85063d2775c', '9d9fa7b8-0e56-4eaa-9190-b3436fd2312b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbdfaa8-a206-40c8-b9f2-9c3edf590911]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:45 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Delete snapshot completed successfully.
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-987194f1-be5a-4adf-97e3-c9389ff5a14a tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-c1bc9a47-cb08-452a-b4a4-16a0a1d17755-delete_snapshot" released by "delete_snapshot" :: held 4.240s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:46 devstack sudo[110444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08
Jun 15 04:36:46 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-1229e02f-f0c9-41bc-a5a2-11c33d409edc-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:46 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-1229e02f-f0c9-41bc-a5a2-11c33d409edc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 1 in 0.989s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Downloaded image b170cd32-bc47-46b9-a1c8-e30710aef8b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'metadata': {}}])) to volume 94dc134f-57c7-47a9-b9d7-240d1392f59c successfully. {{(pid=92103) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Temporary image b170cd32-bc47-46b9-a1c8-e30710aef8b7 for user 095c8395015d4e2e90f70d2cbb8c9aae is deleted. {{(pid=92103) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.volume_utils [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Marking volume 94dc134f-57c7-47a9-b9d7-240d1392f59c as bootable. {{(pid=92103) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Copying metadata from image b170cd32-bc47-46b9-a1c8-e30710aef8b7 to 94dc134f-57c7-47a9-b9d7-240d1392f59c. {{(pid=92103) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Creating volume glance metadata for volume 94dc134f-57c7-47a9-b9d7-240d1392f59c backed by image b170cd32-bc47-46b9-a1c8-e30710aef8b7 with: {'image_id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '506e67913bfc56a273226c6463bf21ed', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92103) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "cinder-quobyte-1229e02f-f0c9-41bc-a5a2-11c33d409edc" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-1229e02f-f0c9-41bc-a5a2-11c33d409edc" acquired by "delete_volume" :: waited 0.042s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6ce82-eab2-42c2-ae81-997dad5c013b]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e877c381-fd22-4365-ab9f-92cb045b7e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94dc134f-57c7-47a9-b9d7-240d1392f59c', 'volume_size': 1, 'image_id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '506e67913bfc56a273226c6463bf21ed', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a55c89f8cdcb443f9242ec14c762ea67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4be1fd00b23097cdf1f03e1bb2606dd777c59fed51cccfa1f2d528a3d942cb0879b995cb55f291e13d032ae458f2eebd1cb322e8ca437a2c1774286d641f0b8', 'id': 'b170cd32-bc47-46b9-a1c8-e30710aef8b7', 'created_at': datetime.datetime(2026, 6, 15, 2, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 2, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b170cd32-bc47-46b9-a1c8-e30710aef8b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7496cdc13320>}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd3fae3-7148-449c-a155-5d2d9c1fb8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:46 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Volume volume-94dc134f-57c7-47a9-b9d7-240d1392f59c (94dc134f-57c7-47a9-b9d7-240d1392f59c): created successfully
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd3fae3-7148-449c-a155-5d2d9c1fb8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Flow 'volume_create_manager' (ede2795f-563e-4954-ab1b-75a2fe16079a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:46 devstack sudo[110482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc
Jun 15 04:36:46 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:46 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-35ced73b-c88a-48ee-b717-923fa204f928 tempest-VolumeImageDependencyTests-1611802120 None] Created volume successfully.
Jun 15 04:36:46 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08" returned: 0 in 0.997s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5b4c424-dab4-45aa-95c5-38c959cbee50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[97badecb-30db-468a-8b9a-09547fbdda23]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:46 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:47 devstack sudo[110487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:36:47 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:47 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc" returned: 0 in 0.793s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:47 devstack sudo[110492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc
Jun 15 04:36:47 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:47 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 0.818s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:47 devstack sudo[110498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132
Jun 15 04:36:47 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Acquiring lock "cinder-94dc134f-57c7-47a9-b9d7-240d1392f59c-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:47 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Lock "cinder-94dc134f-57c7-47a9-b9d7-240d1392f59c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:47 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Acquiring lock "cinder-quobyte-94dc134f-57c7-47a9-b9d7-240d1392f59c" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-1229e02f-f0c9-41bc-a5a2-11c33d409edc" returned: 0 in 0.728s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-quobyte-1229e02f-f0c9-41bc-a5a2-11c33d409edc" released by "delete_volume" :: held 1.622s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Lock "cinder-quobyte-94dc134f-57c7-47a9-b9d7-240d1392f59c" acquired by "delete_volume" :: waited 0.043s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Created reservations ['e16727ce-ac53-46ed-a0e5-aa54f4805d6c', '13d64a6c-74f5-4003-9f32-630a91378ae6', '26bb9fc0-afa2-409e-b41a-3f3780b61616', '3f9b9a56-9e3d-4fb5-8a7c-2f909764f97e'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b6050-6c9f-4209-aa2b-033a2c5a8817]: (4, 'raw') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:48 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:48 devstack sudo[110502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:48 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:48 devstack sudo[110501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:48 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:49 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 0 in 0.973s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:49 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:49 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.076s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:49 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:49 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Deleted volume successfully.
Jun 15 04:36:49 devstack sudo[110512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:49 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:49 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-6fe96089-dd45-4ea2-8ebe-a0cb2145456c tempest-CreateVolumesFromSnapshotTest-389808047 None] Lock "cinder-1229e02f-f0c9-41bc-a5a2-11c33d409edc-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:51 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 1 in 1.922s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c' failed. Not Retrying. {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 04:36:51 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:51 devstack sudo[110524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c
Jun 15 04:36:51 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:52 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-94dc134f-57c7-47a9-b9d7-240d1392f59c" returned: 0 in 1.475s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Lock "cinder-quobyte-94dc134f-57c7-47a9-b9d7-240d1392f59c" released by "delete_volume" :: held 4.495s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Created reservations ['92addb77-419c-4e3d-8c9b-5ffe8c8e58ba', 'df8054d6-ccf4-42b1-89a6-2ca16ca852ca', 'a1e661fc-fcab-48ea-8b78-3d04e93545d6', 'ba2d04c6-377e-4016-b40c-06af9f2cd808'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:52 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:53 devstack sudo[110528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:36:53 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:54 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:54 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 1.682s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:54 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:36:54 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Deleted volume successfully.
Jun 15 04:36:54 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4c3f34bf-1615-4517-8d25-cfdb9439edd7 tempest-VolumeImageDependencyTests-1611802120 None] Lock "cinder-94dc134f-57c7-47a9-b9d7-240d1392f59c-delete_volume" released by "delete_volume" :: held 6.766s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:55 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132" returned: 0 in 7.440s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14ade9-d85f-43ad-b782-f6a43fcf8770]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (a0869177-0413-4918-9cdd-f25a40858dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b45ad7e-1aa3-40df-951f-c87e67a10b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:55 devstack sudo[110531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:36:55 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b45ad7e-1aa3-40df-951f-c87e67a10b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1851992281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ea23d3-f8af-4df8-8448-797a4ae2a97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:55Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b640c21-59bc-4c75-b94d-1332907c24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b640c21-59bc-4c75-b94d-1332907c24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30369b8-b0fc-4ce3-894e-6c0cc955bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30369b8-b0fc-4ce3-894e-6c0cc955bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ea23d3-f8af-4df8-8448-797a4ae2a97c', 'volume_name': 'volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2d43b3-1dcb-499a-b90f-7021f438b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2d43b3-1dcb-499a-b90f-7021f438b081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1cb9ce8-5162-4170-8964-5715662bde3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:55 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume 32ea23d3-f8af-4df8-8448-797a4ae2a97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c', 'volume_size': 1}
Jun 15 04:36:55 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:56 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 1.007s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:36:56 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Converted 1024.00 MB image at 137.61 MB/s
Jun 15 04:36:56 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 is being set with open permissions: ugo+rw
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:56 devstack sudo[110536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132
Jun 15 04:36:56 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:56 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132" returned: 0 in 0.681s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-d75eb266-8813-4719-a512-24d0e57aa132" released by "_copy_volume_from_snapshot" :: held 11.098s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-93b729aa-3e6b-4de8-9926-aca47e29ce08-d75eb266-8813-4719-a512-24d0e57aa132" released by "_create_volume_from_snapshot" :: held 11.141s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:36:56 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.167s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1851992281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ea23d3-f8af-4df8-8448-797a4ae2a97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:36:55Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Creating volume 32ea23d3-f8af-4df8-8448-797a4ae2a97c {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:36:57 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:57 devstack sudo[110539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c 1073741824
Jun 15 04:36:57 devstack sudo[110539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c6554e-81c4-4960-b81d-23cb1afed8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75eb266-8813-4719-a512-24d0e57aa132', 'volume_size': 1, 'snapshot_id': '93b729aa-3e6b-4de8-9926-aca47e29ce08'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79cfd6a-53b5-48e8-8098-43e896e450ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:57 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Volume volume-d75eb266-8813-4719-a512-24d0e57aa132 (d75eb266-8813-4719-a512-24d0e57aa132): created successfully
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79cfd6a-53b5-48e8-8098-43e896e450ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Flow 'volume_create_manager' (c8d7c116-ee68-452d-8b87-192c4494548e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:57 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-85bdd0d7-e96a-45c4-9c4b-87bce11793b7 tempest-VolumeDependencyTests-1470179986 None] Created volume successfully.
Jun 15 04:36:57 devstack sudo[110539]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c 1073741824" returned: 0 in 0.917s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-93b729aa-3e6b-4de8-9926-aca47e29ce08-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-93b729aa-3e6b-4de8-9926-aca47e29ce08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:57 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-quobyte-b5b4c424-dab4-45aa-95c5-38c959cbee50" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-b5b4c424-dab4-45aa-95c5-38c959cbee50" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-quobyte-93b729aa-3e6b-4de8-9926-aca47e29ce08" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:36:58 devstack sudo[110545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c
Jun 15 04:36:58 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-93b729aa-3e6b-4de8-9926-aca47e29ce08" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Deleting offline snapshot 93b729aa-3e6b-4de8-9926-aca47e29ce08 of volume b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] snapshot_file for this snap is: volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db43710-c975-44fa-9e5e-bc2cb0aa7810]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:58 devstack sudo[110547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08
Jun 15 04:36:58 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:58 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c" returned: 0 in 0.686s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1cb9ce8-5162-4170-8964-5715662bde3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecafcec-8d24-4c84-88fb-ec696628cf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:36:58 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c (32ea23d3-f8af-4df8-8448-797a4ae2a97c): created successfully
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecafcec-8d24-4c84-88fb-ec696628cf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:36:58 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (a0869177-0413-4918-9cdd-f25a40858dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:36:58 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-64bffa40-a6f8-4ad2-8bd6-6b1cd0cdcb0e tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created volume successfully.
Jun 15 04:36:59 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08" returned: 0 in 0.895s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:59 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5b4c424-dab4-45aa-95c5-38c959cbee50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:36:59 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e664d3b-455b-49e2-9ffb-2b67d1525b0f]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:36:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:59 devstack sudo[110554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:36:59 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:36:59 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root
Jun 15 04:36:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 0.722s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:36:59 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:36:59 devstack sudo[110559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08
Jun 15 04:36:59 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (1e8a4984-1cc3-49d3-a556-04c8a25dc261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9317ebe9-f2c9-43ab-9831-3cb8eeb6db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9317ebe9-f2c9-43ab-9831-3cb8eeb6db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739388714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd96bb4-7cc1-41c5-b0f9-883720253cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:00Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b80c3a-8312-4172-87af-71fa521d9d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b80c3a-8312-4172-87af-71fa521d9d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3435875-f878-4561-9145-2ef8ddeaf8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3435875-f878-4561-9145-2ef8ddeaf8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd96bb4-7cc1-41c5-b0f9-883720253cd2', 'volume_name': 'volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185a988e-c741-4a36-ba71-63325af593d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185a988e-c741-4a36-ba71-63325af593d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0398aff2-a88c-4cea-af3b-f226f84ae831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume 0bd96bb4-7cc1-41c5-b0f9-883720253cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2', 'volume_size': 1}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739388714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd96bb4-7cc1-41c5-b0f9-883720253cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:00Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Creating volume 0bd96bb4-7cc1-41c5-b0f9-883720253cd2 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:00 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:00 devstack sudo[110561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 1073741824
Jun 15 04:37:00 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (ee37bf82-60f5-4985-9d03-b3f0000a95e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbcafca-5793-4692-8c9b-71ce0e2e5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=148,cinder:UPDATE=180,cinder:INSERT=59,cinder:DELETE=19 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbcafca-5793-4692-8c9b-71ce0e2e5640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-119696212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7d99fe-aa61-43c5-8fdf-59aa2982c131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:01Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fb8f49-dc90-4f0d-9901-79e55ce64788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fb8f49-dc90-4f0d-9901-79e55ce64788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119b2516-389c-4f42-9f3a-28448c451d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119b2516-389c-4f42-9f3a-28448c451d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7d99fe-aa61-43c5-8fdf-59aa2982c131', 'volume_name': 'volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f00921-9a3f-4b4c-be93-0fd7452e2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f00921-9a3f-4b4c-be93-0fd7452e2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99db676b-3bba-4708-bc2b-275193e791b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:00 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume bd7d99fe-aa61-43c5-8fdf-59aa2982c131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131', 'volume_size': 1}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:00 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08" returned: 0 in 1.137s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:00 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:00 devstack sudo[110567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08
Jun 15 04:37:00 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=146,cinder:UPDATE=205,cinder:DELETE=17,cinder:INSERT=48 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (ef15cf9c-0e34-45f1-bbae-ef1d00121c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e7217e-2ea3-4777-869a-c543a7e09ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e7217e-2ea3-4777-869a-c543a7e09ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185234317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bfec4d-0e4c-4912-87d5-b47f9d0e0270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:01Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facc65b4-e6f7-4cdd-a28f-1164c4ded926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facc65b4-e6f7-4cdd-a28f-1164c4ded926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba25536-9520-4019-aa1c-ec79ecefd4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba25536-9520-4019-aa1c-ec79ecefd4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bfec4d-0e4c-4912-87d5-b47f9d0e0270', 'volume_name': 'volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e9e3d3-9bdd-4ed5-a2b3-a59c29de74bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e9e3d3-9bdd-4ed5-a2b3-a59c29de74bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcd2c72-844c-4142-be60-846e104ef0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume f1bfec4d-0e4c-4912-87d5-b47f9d0e0270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270', 'volume_size': 1}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:01 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 1073741824" returned: 0 in 1.260s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:01 devstack sudo[110574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2
Jun 15 04:37:01 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (82bed8c7-8fba-461f-b641-10d067a879d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780c0e19-6c51-46c8-99bf-0b4be7351bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780c0e19-6c51-46c8-99bf-0b4be7351bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373184274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62bec07-cfb4-4748-a2d5-d57435fba797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:02Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d723f2a2-64c4-49c4-8ad4-c4651c22883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d723f2a2-64c4-49c4-8ad4-c4651c22883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b6633a-3357-41f2-a726-49313275075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b6633a-3357-41f2-a726-49313275075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62bec07-cfb4-4748-a2d5-d57435fba797', 'volume_name': 'volume-c62bec07-cfb4-4748-a2d5-d57435fba797', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00c91d0-e5da-496f-90d8-38cc732a83ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00c91d0-e5da-496f-90d8-38cc732a83ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a57e719-0700-45d8-9acd-b4cd836c2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:01 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume c62bec07-cfb4-4748-a2d5-d57435fba797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62bec07-cfb4-4748-a2d5-d57435fba797', 'volume_size': 1}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50.93b729aa-3e6b-4de8-9926-aca47e29ce08" returned: 0 in 0.916s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-93b729aa-3e6b-4de8-9926-aca47e29ce08" released by "_delete_snapshot" :: held 3.822s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:01 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-b5b4c424-dab4-45aa-95c5-38c959cbee50" released by "delete_snapshot" :: held 3.867s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Created reservations ['18fc2948-54b9-48fa-8919-a46216bac473', '70ca7b10-b866-42e8-8945-3511b5ac0a08', '48ddf9ff-d06a-4737-bcdd-a90794c31a2d', '1855a0b6-d80a-4b0b-990c-93a23c21f7d6'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Delete snapshot completed successfully.
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d8c68d3a-763d-41eb-93e0-0438cf5b03c3 tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-93b729aa-3e6b-4de8-9926-aca47e29ce08-delete_snapshot" released by "delete_snapshot" :: held 4.135s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (02d1a243-7275-4388-8138-1c6c0afc231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0613f70c-1c67-4ca3-b932-4d0697ff8a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0613f70c-1c67-4ca3-b932-4d0697ff8a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909780370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7a5e61-8923-43ef-a18e-dc6b663fb77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:02Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b9ab3f-96b6-4d21-ad84-bea8570d7f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b9ab3f-96b6-4d21-ad84-bea8570d7f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d7bfa-4b97-4bc6-ae18-2369cd03f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d7bfa-4b97-4bc6-ae18-2369cd03f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7a5e61-8923-43ef-a18e-dc6b663fb77f', 'volume_name': 'volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596a9d07-d109-419c-8c87-93683b74a5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596a9d07-d109-419c-8c87-93683b74a5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004ac39f-300e-4f4d-96a9-48e525650791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume 5e7a5e61-8923-43ef-a18e-dc6b663fb77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f', 'volume_size': 1}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-b5b4c424-dab4-45aa-95c5-38c959cbee50-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-b5b4c424-dab4-45aa-95c5-38c959cbee50-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-quobyte-b5b4c424-dab4-45aa-95c5-38c959cbee50" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-b5b4c424-dab4-45aa-95c5-38c959cbee50" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[66abef4a-b919-41cc-a91c-7060229724eb]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:02 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2" returned: 0 in 0.986s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] <== create_volume: return (2321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:02 devstack sudo[110577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-119696212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7d99fe-aa61-43c5-8fdf-59aa2982c131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:01Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Creating volume bd7d99fe-aa61-43c5-8fdf-59aa2982c131 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:37:02 devstack sudo[110577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:02 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:02 devstack sudo[110579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 1073741824
Jun 15 04:37:02 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0398aff2-a88c-4cea-af3b-f226f84ae831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2703c0-c6b5-488c-a40e-3ccad8ecf6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:02 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 (0bd96bb4-7cc1-41c5-b0f9-883720253cd2): created successfully
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2703c0-c6b5-488c-a40e-3ccad8ecf6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:02 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (1e8a4984-1cc3-49d3-a556-04c8a25dc261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:02 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-1933ec61-99b8-42bd-9b4e-3f9662c60456 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created volume successfully.
Jun 15 04:37:03 devstack sudo[110577]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 0.964s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:03 devstack sudo[110588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50
Jun 15 04:37:03 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:03 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 1073741824" returned: 0 in 1.001s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:03 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:03 devstack sudo[110591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131
Jun 15 04:37:03 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:04 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-b5b4c424-dab4-45aa-95c5-38c959cbee50" returned: 0 in 0.671s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-b5b4c424-dab4-45aa-95c5-38c959cbee50" released by "delete_volume" :: held 1.729s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Created reservations ['9db9f5b0-25b8-412e-82ce-c113d175845d', 'a977eb28-80fe-4542-90c6-58591225922f', '24748f14-c43f-4782-ac27-d0ff570c5e48', 'beaca6be-13aa-4b56-9190-b6d54e5a8d09'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:04 devstack sudo[110595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:04 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:04 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131" returned: 0 in 0.810s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.036s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185234317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bfec4d-0e4c-4912-87d5-b47f9d0e0270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:01Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Creating volume f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:04 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99db676b-3bba-4708-bc2b-275193e791b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:04 devstack sudo[110598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 1073741824
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cb8e7-b972-45af-bb47-70670f93760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:04 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:04 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 (bd7d99fe-aa61-43c5-8fdf-59aa2982c131): created successfully
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cb8e7-b972-45af-bb47-70670f93760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (ee37bf82-60f5-4985-9d03-b3f0000a95e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-969c16eb-0655-40af-a7dd-a908174cdf6c tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created volume successfully.
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-d75eb266-8813-4719-a512-24d0e57aa132-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-d75eb266-8813-4719-a512-24d0e57aa132-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "cinder-quobyte-d75eb266-8813-4719-a512-24d0e57aa132" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-d75eb266-8813-4719-a512-24d0e57aa132" acquired by "delete_volume" :: waited 0.031s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c08341-ecf4-4473-8c95-a09769519ba3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:04 devstack sudo[110600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132
Jun 15 04:37:04 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:04 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.668s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:04 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:04 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Deleted volume successfully.
Jun 15 04:37:05 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-db6bc562-c355-42ba-9f0a-6812a96f931d tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-b5b4c424-dab4-45aa-95c5-38c959cbee50-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:05 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 1073741824" returned: 0 in 1.012s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:05 devstack sudo[110609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270
Jun 15 04:37:05 devstack sudo[110609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:05 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132" returned: 0 in 0.944s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:05 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:05 devstack sudo[110612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132
Jun 15 04:37:05 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:06 devstack sudo[110609]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270" returned: 0 in 0.624s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.313s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373184274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62bec07-cfb4-4748-a2d5-d57435fba797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:02Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Creating volume c62bec07-cfb4-4748-a2d5-d57435fba797 {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:06 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcd2c72-844c-4142-be60-846e104ef0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c763e6e9-a19d-4604-84a5-b93aba1c7a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:06 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 (f1bfec4d-0e4c-4912-87d5-b47f9d0e0270): created successfully
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c763e6e9-a19d-4604-84a5-b93aba1c7a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (ef15cf9c-0e34-45f1-bbae-ef1d00121c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:06 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b5138d92-4a1d-418b-814c-f1a98153a5d6 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created volume successfully.
Jun 15 04:37:06 devstack sudo[110615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797 1073741824
Jun 15 04:37:06 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:06 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-d75eb266-8813-4719-a512-24d0e57aa132" returned: 0 in 0.678s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-quobyte-d75eb266-8813-4719-a512-24d0e57aa132" released by "delete_volume" :: held 1.687s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Created reservations ['4969d6cf-f732-4bbf-b9b7-1bd549c47abe', 'f72f6aad-1c89-44e7-aa2f-b0c78db1ac02', 'b5429185-72fe-4752-965f-d2fc72a5f1ad', '48317436-23e4-4226-a2e2-4c8a6118dbba'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:06 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:06 devstack sudo[110620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:06 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:07 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.686s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:07 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:07 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Deleted volume successfully.
Jun 15 04:37:07 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:07 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4a0fda9c-3109-4fcc-86a5-5c235add9e8e tempest-VolumeDependencyTests-1470179986 None] Lock "cinder-d75eb266-8813-4719-a512-24d0e57aa132-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797 1073741824" returned: 0 in 1.197s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:07 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:07 devstack sudo[110628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797
Jun 15 04:37:07 devstack sudo[110628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:08 devstack sudo[110628]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797" returned: 0 in 0.745s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.858s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909780370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7a5e61-8923-43ef-a18e-dc6b663fb77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cde795e6c2455aaf44aa608d8919d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:02Z,use_quota=True,user_id='be2b8e206b54413cb5601c090391b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Creating volume 5e7a5e61-8923-43ef-a18e-dc6b663fb77f {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:08 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a57e719-0700-45d8-9acd-b4cd836c2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62bec07-cfb4-4748-a2d5-d57435fba797', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4f25b4-21cc-4f0b-9cf1-fcf988c81921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:08 devstack sudo[110631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f 1073741824
Jun 15 04:37:08 devstack sudo[110631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:08 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume volume-c62bec07-cfb4-4748-a2d5-d57435fba797 (c62bec07-cfb4-4748-a2d5-d57435fba797): created successfully
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4f25b4-21cc-4f0b-9cf1-fcf988c81921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:08 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (82bed8c7-8fba-461f-b641-10d067a879d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:08 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-bf8c76fa-21e8-4964-bfa2-b50c20d56b7d tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created volume successfully.
Jun 15 04:37:09 devstack sudo[110631]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f 1073741824" returned: 0 in 0.991s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:09 devstack sudo[110637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f
Jun 15 04:37:09 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:09 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f" returned: 0 in 0.632s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004ac39f-300e-4f4d-96a9-48e525650791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60d90d7-31be-4680-9dda-59836a85fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:09 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Volume volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f (5e7a5e61-8923-43ef-a18e-dc6b663fb77f): created successfully
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60d90d7-31be-4680-9dda-59836a85fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:09 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Flow 'volume_create_manager' (02d1a243-7275-4388-8138-1c6c0afc231a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:09 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8172e7f2-c26d-464b-aed5-164e05735842 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created volume successfully.
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-5e7a5e61-8923-43ef-a18e-dc6b663fb77f-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-5e7a5e61-8923-43ef-a18e-dc6b663fb77f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-quobyte-5e7a5e61-8923-43ef-a18e-dc6b663fb77f" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-5e7a5e61-8923-43ef-a18e-dc6b663fb77f" acquired by "delete_volume" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8dafaf-02aa-4bcf-bc67-23fe7bf215be]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:10 devstack sudo[110640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f
Jun 15 04:37:10 devstack sudo[110640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:10 devstack sudo[110640]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f" returned: 0 in 0.749s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:10 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:11 devstack sudo[110646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f
Jun 15 04:37:11 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:11 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-5e7a5e61-8923-43ef-a18e-dc6b663fb77f" returned: 0 in 0.616s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-5e7a5e61-8923-43ef-a18e-dc6b663fb77f" released by "delete_volume" :: held 1.420s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created reservations ['c6c37876-b3c3-4f72-aa94-a3023ae9b9ae', 'f607c531-5df2-44ec-a04e-9bd64793d0e2', '661d78ce-b38f-49d4-a932-762572c75d93', '7234702b-8214-4b89-bc43-8f23c22ff13b'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:11 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:11 devstack sudo[110649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:11 devstack sudo[110649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:12 devstack sudo[110649]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.660s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:12 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Deleted volume successfully.
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-c62bec07-cfb4-4748-a2d5-d57435fba797-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e0330e18-5bc6-4dda-9901-0ff5a67c0665 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-5e7a5e61-8923-43ef-a18e-dc6b663fb77f-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-c62bec07-cfb4-4748-a2d5-d57435fba797-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-quobyte-c62bec07-cfb4-4748-a2d5-d57435fba797" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-c62bec07-cfb4-4748-a2d5-d57435fba797" acquired by "delete_volume" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc5b6e5-378e-48cd-8bcb-a12599436684]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:12 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:12 devstack sudo[110652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797
Jun 15 04:37:12 devstack sudo[110652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:13 devstack sudo[110652]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797" returned: 0 in 0.801s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:13 devstack sudo[110657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797
Jun 15 04:37:13 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:13 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:13 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-c62bec07-cfb4-4748-a2d5-d57435fba797" returned: 0 in 0.617s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:13 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-c62bec07-cfb4-4748-a2d5-d57435fba797" released by "delete_volume" :: held 1.471s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Flow 'volume_create_manager' (128b2cfc-8f98-4813-a5bc-6b8a8baccea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8709e-d527-41b1-8c70-d474eabd015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8709e-d527-41b1-8c70-d474eabd015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-155669579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae98be7b-0a56-4599-bc78-4e322c8d15ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dda461b63944ff9b63399836836c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:14Z,use_quota=True,user_id='d87eb94077e949f898e1ce34d4851d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9601ac-3910-490d-8e13-2e34905a1537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9601ac-3910-490d-8e13-2e34905a1537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5b107a-788a-4dc3-98ad-47bc2826674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5b107a-788a-4dc3-98ad-47bc2826674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae98be7b-0a56-4599-bc78-4e322c8d15ec', 'volume_name': 'volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c243e7-fc53-417b-9f42-0a9131f71631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c243e7-fc53-417b-9f42-0a9131f71631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c9e7ac-7de6-43ff-98c8-86b2da602f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:14 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Volume ae98be7b-0a56-4599-bc78-4e322c8d15ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec', 'volume_size': 1}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7496ce57b860>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-155669579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae98be7b-0a56-4599-bc78-4e322c8d15ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dda461b63944ff9b63399836836c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:14Z,use_quota=True,user_id='d87eb94077e949f898e1ce34d4851d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)}" {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Creating volume ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:14 devstack cinder-volume[92103]: INFO cinder.volume.drivers.remotefs [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] casted to osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec 1073741824 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created reservations ['3efcf045-2b98-4dd5-a47b-9ff903f9ac24', 'd464b439-c4ce-4a19-aca7-4d891c4d4647', '9b69c52a-4e4f-4e74-9b28-f3950b39476b', '0fc0eae1-7a89-40f2-a0a0-fac9d05da14f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:14 devstack sudo[110660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec 1073741824
Jun 15 04:37:14 devstack sudo[110660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:14 devstack sudo[110662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:14 devstack sudo[110662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-quobyte-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffce043b-26a9-4e43-a154-4254a5c8103a]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:14 devstack sudo[110662]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.615s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:14 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Deleted volume successfully.
Jun 15 04:37:14 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-8a8df0f6-9912-4219-9132-de67edf37ac8 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-c62bec07-cfb4-4748-a2d5-d57435fba797-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:14 devstack sudo[110668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270
Jun 15 04:37:14 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:15 devstack sudo[110660]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec 1073741824" returned: 0 in 0.877s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:15 devstack sudo[110670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:15 devstack sudo[110670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:15 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270" returned: 0 in 0.742s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:15 devstack sudo[110676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270
Jun 15 04:37:15 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:15 devstack sudo[110670]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.592s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'} {{(pid=92103) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c9e7ac-7de6-43ff-98c8-86b2da602f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec', 'volume_size': 1}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8098dad-9796-457d-8f70-0be4787ccf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:15 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Volume volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec (ae98be7b-0a56-4599-bc78-4e322c8d15ec): created successfully
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8098dad-9796-457d-8f70-0be4787ccf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:15 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Flow 'volume_create_manager' (128b2cfc-8f98-4813-a5bc-6b8a8baccea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:15 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-24f5c991-1d53-4e78-a024-11c9f53ab7b7 tempest-SnapshotDependencyTests-1185301320 None] Created volume successfully.
Jun 15 04:37:16 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270" returned: 0 in 0.593s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270" released by "delete_volume" :: held 1.377s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created reservations ['90c50dd8-9c8c-43d0-8397-93eca2a56aa8', 'cd16fc85-bf5c-4bd8-b431-1752a61c56f0', 'f07956c7-d895-4c83-a4ac-98c1b551e5b2', 'ebf470f4-0daa-429f-976c-a528ad104e09'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:16 devstack sudo[110679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:16 devstack sudo[110679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Creating offline snapshot 9644096b-81da-4a2c-bcf5-75223374b9a1 of volume ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[517b8430-c0ab-492f-8a80-bf947edfe1e1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:16 devstack sudo[110681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:16 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:16 devstack sudo[110679]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:16 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Deleted volume successfully.
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-4f20bd5e-4de0-47d1-a66f-c63d5e74eba0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-f1bfec4d-0e4c-4912-87d5-b47f9d0e0270-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-bd7d99fe-aa61-43c5-8fdf-59aa2982c131-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:16 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-bd7d99fe-aa61-43c5-8fdf-59aa2982c131-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-quobyte-bd7d99fe-aa61-43c5-8fdf-59aa2982c131" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-bd7d99fe-aa61-43c5-8fdf-59aa2982c131" acquired by "delete_volume" :: waited 0.021s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b758e1-7289-485b-9f97-c6d24ed4926c]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:17 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.730s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 1G {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:17 devstack sudo[110688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 1G
Jun 15 04:37:17 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:17 devstack sudo[110687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131
Jun 15 04:37:17 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:17 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131" returned: 0 in 0.748s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:17 devstack sudo[110698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131
Jun 15 04:37:17 devstack sudo[110698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:17 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 1G" returned: 0 in 0.746s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:17 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:17 devstack sudo[110700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1
Jun 15 04:37:17 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:18 devstack sudo[110698]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-bd7d99fe-aa61-43c5-8fdf-59aa2982c131" returned: 0 in 0.603s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-bd7d99fe-aa61-43c5-8fdf-59aa2982c131" released by "delete_volume" :: held 1.392s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created reservations ['52fa375f-20a8-4460-8cf6-e9bff5103f35', '18cb682f-35c9-41c4-b39b-eb7f9f7cebdb', '051a073c-58d2-4513-a813-18db3921f1f1', '6964501f-52ca-4d41-aa76-b21a894912b6'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:18 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec -F qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1" returned: 0 in 0.664s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:18 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 is being set with open permissions: ugo+rw
Jun 15 04:37:18 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:18 devstack sudo[110706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:18 devstack sudo[110706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:18 devstack sudo[110707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1
Jun 15 04:37:18 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:19 devstack sudo[110706]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.581s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:19 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Deleted volume successfully.
Jun 15 04:37:19 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1" returned: 0 in 0.597s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-c0699162-b97f-4932-90b7-a956efc374d0 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-bd7d99fe-aa61-43c5-8fdf-59aa2982c131-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-0bd96bb4-7cc1-41c5-b0f9-883720253cd2-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:19 devstack sudo[110712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info
Jun 15 04:37:19 devstack sudo[110712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-0bd96bb4-7cc1-41c5-b0f9-883720253cd2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-quobyte-0bd96bb4-7cc1-41c5-b0f9-883720253cd2" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-0bd96bb4-7cc1-41c5-b0f9-883720253cd2" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae6c79a-791a-45fa-ae5e-3656574124e5]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:19 devstack sudo[110714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2
Jun 15 04:37:19 devstack sudo[110714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:19 devstack sudo[110712]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info" returned: 0 in 0.611s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:19 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info is being set with open permissions: ugo+rw
Jun 15 04:37:19 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:19 devstack sudo[110717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info
Jun 15 04:37:19 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:20 devstack sudo[110714]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2" returned: 0 in 0.710s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:20 devstack sudo[110722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2
Jun 15 04:37:20 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:20 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.info" returned: 0 in 0.609s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.047s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:20 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-b614e679-7546-460a-ab4d-1c54cd178ee4 tempest-SnapshotDependencyTests-1185301320 None] Create snapshot completed successfully
Jun 15 04:37:20 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-0bd96bb4-7cc1-41c5-b0f9-883720253cd2" returned: 0 in 0.604s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-0bd96bb4-7cc1-41c5-b0f9-883720253cd2" released by "delete_volume" :: held 1.357s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created reservations ['314593cd-55ee-4f35-b03d-6c33fb03a5cc', '7bb340a3-13a3-4d87-8649-ba696fb2a07a', 'b340c0fa-2f2b-4f56-9cef-8709c828b2c1', '1244571d-081c-414b-974c-e3a512c6a845'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:20 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:20 devstack sudo[110726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:20 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:21 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.576s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:21 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Deleted volume successfully.
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-ec9abe57-615e-481c-9f00-79547af6b179 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-0bd96bb4-7cc1-41c5-b0f9-883720253cd2-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-32ea23d3-f8af-4df8-8448-797a4ae2a97c-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-32ea23d3-f8af-4df8-8448-797a4ae2a97c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "cinder-quobyte-32ea23d3-f8af-4df8-8448-797a4ae2a97c" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-32ea23d3-f8af-4df8-8448-797a4ae2a97c" acquired by "delete_volume" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[04daf663-a6d9-4c1c-9d6d-2520f5a69979]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:21 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:21 devstack sudo[110730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c
Jun 15 04:37:21 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92103) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Flow 'volume_create_manager' (5b256ba6-20dd-49b9-9353-7f63b1cd1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070e6ea7-f29b-4e53-83ed-356fcfc7361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070e6ea7-f29b-4e53-83ed-356fcfc7361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T02:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4c093f-26a1-4427-95bc-2c192fe76658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dda461b63944ff9b63399836836c77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T02:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9644096b-81da-4a2c-bcf5-75223374b9a1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T02:37:22Z,use_quota=True,user_id='d87eb94077e949f898e1ce34d4851d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00368f7d-dd06-460e-99a8-436529172075),volume_type_id=00368f7d-dd06-460e-99a8-436529172075)' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ef7234-1a0e-4d38-84d6-2d7ea30f0703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ef7234-1a0e-4d38-84d6-2d7ea30f0703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787339de-57b0-4904-98eb-e7d856d8a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787339de-57b0-4904-98eb-e7d856d8a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff4c093f-26a1-4427-95bc-2c192fe76658', 'volume_name': 'volume-ff4c093f-26a1-4427-95bc-2c192fe76658', 'volume_size': 1, 'snapshot_id': '9644096b-81da-4a2c-bcf5-75223374b9a1'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ab33f9-07fd-4cf0-9226-09f0b74e03ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ab33f9-07fd-4cf0-9226-09f0b74e03ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1663053c-d1cc-48c0-839e-b43376d6e91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:22 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Volume ff4c093f-26a1-4427-95bc-2c192fe76658: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff4c093f-26a1-4427-95bc-2c192fe76658', 'volume_size': 1, 'snapshot_id': '9644096b-81da-4a2c-bcf5-75223374b9a1'}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-quobyte-9644096b-81da-4a2c-bcf5-75223374b9a1-ff4c093f-26a1-4427-95bc-2c192fe76658" by "_create_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-9644096b-81da-4a2c-bcf5-75223374b9a1-ff4c093f-26a1-4427-95bc-2c192fe76658" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Creating volume ff4c093f-26a1-4427-95bc-2c192fe76658 from snapshot 9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Selected osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac as target Quobyte volume. {{(pid=92103) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-quobyte-ff4c093f-26a1-4427-95bc-2c192fe76658" by "_copy_volume_from_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ff4c093f-26a1-4427-95bc-2c192fe76658" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] snapshot: 9644096b-81da-4a2c-bcf5-75223374b9a1, volume: ff4c093f-26a1-4427-95bc-2c192fe76658,  {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[5524fc5d-00f3-477f-9079-0b11856d3f42]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:22 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c" returned: 0 in 0.758s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:22 devstack sudo[110736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c
Jun 15 04:37:22 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:22 devstack sudo[110735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1
Jun 15 04:37:22 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:22 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-32ea23d3-f8af-4df8-8448-797a4ae2a97c" returned: 0 in 0.618s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-quobyte-32ea23d3-f8af-4df8-8448-797a4ae2a97c" released by "delete_volume" :: held 1.420s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:22 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1" returned: 0 in 0.731s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Creating direct copy from snapshot {{(pid=92103) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Created reservations ['1c3be842-11f3-4aec-87a1-4f6cbe3d5d4c', 'd24fef38-62aa-43a0-8af3-8b69f46faa39', '8df118d2-0cd5-495a-a74f-74e749745efb', '1d1f2948-3645-4795-a80b-bc4d52e56830'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[13108076-6a4c-4261-93e9-82e65f6d5aa3]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:22 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:23 devstack sudo[110744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:23 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:23 devstack sudo[110743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:23 devstack sudo[110743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:23 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.610s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:23 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Deleted volume successfully.
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-37247308-3d27-4e57-8c15-101d5d35a305 tempest-CreateVolumesFromSourceVolumeTest-938688805 None] Lock "cinder-32ea23d3-f8af-4df8-8448-797a4ae2a97c-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:23 devstack sudo[110743]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.742s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG cinder.utils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Path /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 not found in is_blk_device check {{(pid=92103) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 04:37:23 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:23 devstack sudo[110752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658
Jun 15 04:37:23 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:28 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658" returned: 0 in 4.814s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:28 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18584ba-6e04-4e17-a724-5e8d152f61a1]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:28 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:28 devstack sudo[110775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:28 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:29 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.857s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG cinder.image.image_utils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 {{(pid=92103) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 04:37:29 devstack cinder-volume[92103]: INFO cinder.image.image_utils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Converted 1024.00 MB image at 212.66 MB/s
Jun 15 04:37:29 devstack cinder-volume[92103]: WARNING cinder.volume.drivers.remotefs [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 is being set with open permissions: ugo+rw
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:29 devstack sudo[110780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658
Jun 15 04:37:29 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:29 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658" returned: 0 in 0.580s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ff4c093f-26a1-4427-95bc-2c192fe76658" released by "_copy_volume_from_snapshot" :: held 7.821s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-9644096b-81da-4a2c-bcf5-75223374b9a1-ff4c093f-26a1-4427-95bc-2c192fe76658" released by "_create_volume_from_snapshot" :: held 7.851s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:29 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.867s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1663053c-d1cc-48c0-839e-b43376d6e91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4c093f-26a1-4427-95bc-2c192fe76658', 'volume_size': 1, 'snapshot_id': '9644096b-81da-4a2c-bcf5-75223374b9a1'}' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da1999d-b6ca-4b1f-8e39-ddb0e07e9e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 04:37:30 devstack cinder-volume[92103]: INFO cinder.volume.flows.manager.create_volume [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Volume volume-ff4c093f-26a1-4427-95bc-2c192fe76658 (ff4c093f-26a1-4427-95bc-2c192fe76658): created successfully
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da1999d-b6ca-4b1f-8e39-ddb0e07e9e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92103) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Flow 'volume_create_manager' (5b256ba6-20dd-49b9-9353-7f63b1cd1679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92103) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 04:37:30 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-3eb22832-2ff8-4316-be8f-09afc1197542 tempest-SnapshotDependencyTests-1185301320 None] Created volume successfully.
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-9644096b-81da-4a2c-bcf5-75223374b9a1-delete_snapshot" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-9644096b-81da-4a2c-bcf5-75223374b9a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-quobyte-ae98be7b-0a56-4599-bc78-4e322c8d15ec" by "delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ae98be7b-0a56-4599-bc78-4e322c8d15ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-quobyte-9644096b-81da-4a2c-bcf5-75223374b9a1" by "_delete_snapshot" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-9644096b-81da-4a2c-bcf5-75223374b9a1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Deleting offline snapshot 9644096b-81da-4a2c-bcf5-75223374b9a1 of volume ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] snapshot_file for this snap is: volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e441393-cd98-4c9f-bcc3-1d4ffaa9bc2e]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:30 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:30 devstack sudo[110783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1
Jun 15 04:37:30 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:31 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1" returned: 0 in 0.680s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:31 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.remotefs [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92103) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 04:37:31 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ededbae4-e9b4-44a7-9a3d-a2861a094cd7]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:31 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:31 devstack sudo[110789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:31 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:32 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.694s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:32 devstack sudo[110794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1
Jun 15 04:37:32 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:32 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1" returned: 0 in 0.645s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:32 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:32 devstack sudo[110799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1
Jun 15 04:37:32 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:33 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec.9644096b-81da-4a2c-bcf5-75223374b9a1" returned: 0 in 0.575s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-9644096b-81da-4a2c-bcf5-75223374b9a1" released by "_delete_snapshot" :: held 2.682s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ae98be7b-0a56-4599-bc78-4e322c8d15ec" released by "delete_snapshot" :: held 2.703s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Created reservations ['995e0f1f-c9ef-4636-ae05-14ab958fa645', 'f396802f-6c05-4232-9041-565a993f79c0', '95e6a42a-bea8-451c-a877-10ca39ce1c7f', '0855115b-c3de-4406-ad6e-0c19e568308f'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:33 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Delete snapshot completed successfully.
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-cf4343f9-f770-4800-99b8-f5eac900595f tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-9644096b-81da-4a2c-bcf5-75223374b9a1-delete_snapshot" released by "delete_snapshot" :: held 2.823s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-ae98be7b-0a56-4599-bc78-4e322c8d15ec-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-ae98be7b-0a56-4599-bc78-4e322c8d15ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:33 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-quobyte-ae98be7b-0a56-4599-bc78-4e322c8d15ec" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:34 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ae98be7b-0a56-4599-bc78-4e322c8d15ec" acquired by "delete_volume" :: waited 0.016s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:34 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01c561-c3d8-4562-bc1f-869845c13097]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:34 devstack sudo[110802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:34 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:34 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.684s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:34 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:34 devstack sudo[110807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec
Jun 15 04:37:34 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:35 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ae98be7b-0a56-4599-bc78-4e322c8d15ec" returned: 0 in 0.593s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ae98be7b-0a56-4599-bc78-4e322c8d15ec" released by "delete_volume" :: held 1.330s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Created reservations ['3812c628-fa7c-4dc7-b6f4-329854b6a3e0', '825bdbed-af2b-4b8c-a942-c721058a5b05', '10d4340a-f906-469d-9a02-1873e6e4d87f', 'e876449d-3032-4470-ab09-1e97339b2053'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:35 devstack sudo[110810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:35 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:35 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:35 devstack sudo[110812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:35 devstack sudo[110812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:36 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.600s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:36 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Deleted volume successfully.
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-e30b74e5-f137-48ce-8654-819c5465a5ef tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-ae98be7b-0a56-4599-bc78-4e322c8d15ec-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:36 devstack sudo[110812]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.591s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo_service.periodic_task [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] Running periodic task VolumeManager._thread_info {{(pid=92103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread count: 28 {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.volume.manager [None req-1ce989ce-4113-4e26-8c4c-082112d5ef9b None None] thread info: [<_MainThread(MainThread, started 128191165157504)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128191058520576)>, <Thread(Thread-3 (stat_writer), started daemon 128191055440896)>, <Thread(Rabbit-heartbeat, started daemon 128191054115968)>, <Thread(Thread-5 (_runner), started daemon 128191054281920)>, <Thread(Thread-7 (_runner), started daemon 128191054327936)>, <Thread(fd_logger, started daemon 128191050291712)>, <Thread(privsep_reader, started daemon 128191050377344)>, <Thread(tpool_thread_0, started daemon 128191043978944)>, <Thread(tpool_thread_1, started daemon 128191035586240)>, <Thread(tpool_thread_2, started daemon 128191027193536)>, <Thread(tpool_thread_3, started daemon 128191018800832)>, <Thread(tpool_thread_4, started daemon 128191010408128)>, <Thread(tpool_thread_5, started daemon 128191002015424)>, <Thread(tpool_thread_6, started daemon 128190993622720)>, <Thread(tpool_thread_7, started daemon 128190985230016)>, <Thread(tpool_thread_8, started daemon 128190976837312)>, <Thread(tpool_thread_9, started daemon 128190968444608)>, <Thread(tpool_thread_10, started daemon 128190960051904)>, <Thread(tpool_thread_11, started daemon 128190951659200)>, <Thread(tpool_thread_12, started daemon 128190943266496)>, <Thread(tpool_thread_13, started daemon 128190934873792)>, <Thread(tpool_thread_14, started daemon 128190926481088)>, <Thread(tpool_thread_15, started daemon 128190918088384)>, <Thread(tpool_thread_16, started daemon 128190909695680)>, <Thread(tpool_thread_17, started daemon 128190901302976)>, <Thread(tpool_thread_18, started daemon 128190892910272)>, <Thread(tpool_thread_19, started daemon 128190884517568)>] {{(pid=92103) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-ff4c093f-26a1-4427-95bc-2c192fe76658-delete_volume" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-ff4c093f-26a1-4427-95bc-2c192fe76658-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "cinder-quobyte-ff4c093f-26a1-4427-95bc-2c192fe76658" by "delete_volume" {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ff4c093f-26a1-4427-95bc-2c192fe76658" acquired by "delete_volume" :: waited 0.015s {{(pid=92103) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9fed8-2ebd-4961-851d-0030cf438bc2]: (4, 'qcow2') {{(pid=92968) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:36 devstack sudo[110816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658
Jun 15 04:37:36 devstack sudo[110816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:36 devstack sudo[110816]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658" returned: 0 in 0.685s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:36 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658 {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:36 devstack sudo[110821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658
Jun 15 04:37:36 devstack sudo[110821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:37 devstack sudo[110821]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a/volume-ff4c093f-26a1-4427-95bc-2c192fe76658" returned: 0 in 0.583s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-quobyte-ff4c093f-26a1-4427-95bc-2c192fe76658" released by "delete_volume" :: held 1.306s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG cinder.quota [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Created reservations ['571d68e6-79f2-4bca-9d6d-db57128308c3', '318584d0-94cb-4bcc-b33b-586f2fd9abbb', '587af22d-05f2-4b9c-965b-02ae66f6ed37', '19a167f4-2171-427f-af49-84f0d70515da'] {{(pid=92103) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac': None} {{(pid=92103) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG cinder.volume.drivers.quobyte [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d8312ac-b369-4347-a09d-3f7f8e5ae1ac'] {{(pid=92103) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.lockutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 04:37:37 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 04:37:37 devstack sudo[110824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a
Jun 15 04:37:37 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 04:37:38 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root
Jun 15 04:37:38 devstack cinder-volume[92103]: DEBUG oslo_concurrency.processutils [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e400dcc428b3c80328e47ad5ad45b3a" returned: 0 in 0.579s {{(pid=92103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 04:37:38 devstack cinder-volume[92103]: DEBUG cinder.manager [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Notifying Schedulers of capabilities ... {{(pid=92103) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 04:37:38 devstack cinder-volume[92103]: INFO cinder.volume.manager [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Deleted volume successfully.
Jun 15 04:37:38 devstack cinder-volume[92103]: DEBUG cinder.coordination [None req-d5c4ba25-5ea5-4f42-96f9-8e349f7bf1bd tempest-SnapshotDependencyTests-1185301320 None] Lock "cinder-ff4c093f-26a1-4427-95bc-2c192fe76658-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=92103) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 04:37:56 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:UPDATE=109,cinder:SELECT=75,cinder:INSERT=27,cinder:DELETE=10 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 04:37:56 devstack cinder-volume[92103]: DEBUG dbcounter [-] [92103] Writing DB stats cinder:SELECT=79,cinder:UPDATE=115,cinder:INSERT=28,cinder:DELETE=8 {{(pid=92103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}