Task Types¶

This section examines coverage and performance across task types in SEB. The task types categories are derived from the MTEB benchmark.

Performance across Tasks Types¶

The table show the performance across task types:

The follows table give you and an overview of the coverage of the tasks:

		Across	· Danish	Norwegian Bokmål	Norwegian Nynorsk	Swedish
Formalization	Task
Retrieval	Question answering	✓	✓	✓		✓
	article retrieval	✓	✓	✓		✓
bitext Mining	dialect pairing	✓	✓	✓	✓
Classification	Political	✓		✓	✓
	Language Identification	✓	✓	✓	✓	✓
	Linguistic Acceptability	✓	✓	✓	✓	✓
	Sentiment/Hate Speech	✓	✓	✓		✓
	Dialog Systems	✓	✓	✓	✓	✓
Clustering	Thematic Clustering	✓		✓		✓
Reranking
Pair Classification
STS