LiveFR

MMLU

Definition: MMLU (Massive Multitask Language Understanding) is a multiple-choice benchmark spanning many academic and professional domains.

It measures the breadth of a model's general knowledge. Long a standard, it saturates as models improve, which limits its discriminating power.

See also

← Full AI glossary · AI news