OpenAI debuts IndQA, a benchmark rooted in Indias languages and cultural context

Current benchmarks focus on translation or multiple-choice tasks and dont capture what matters for evaluating an AI systems language capabilities, which is understanding context, culture, history, among others.