To be able to assist builders globally perceive giant language fashions (LLMs) higher, the corporate has funded and revealed an expert translation of the Large Multitask Language Understanding (MMLU) benchmark in 14 languages by way of Hugging Face.
“Supporting those that (builders) perceive the distinctive cultures, economies, and social dynamics of their communities will assist be certain that AI functions are tailor-made to fulfill native wants,” the corporate defined.
The MMLU benchmark is offered in a number of languages, together with Arabic, Bengali, Chinese language, French, German, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Spanish, Swahili, and Yoruba.
