← Back to articles
Large Language ModelsAI Safety & Alignment

MATH-PT benchmark dataset introduces 1,729 mathematical problems in European and Brazilian Portuguese to address linguistic bias in LLM reasoning evaluations

arXiv cs.CL · April 30, 2026

AI Summary

  • •Researchers released MATH-PT, a dataset of 1,729 mathematical problems written in European and Brazilian Portuguese, sourced from mathematical Olympiads, competitions, and exams from Portugal and Brazil.
  • •Frontier reasoning models (advanced LLMs that perform complex logical inference) showed strong performance on multiple choice questions compared to open weight models, but their performance decreased for questions with figures or open-ended questions.
  • •The benchmark addresses a significant gap: most mathematical reasoning evaluations are exclusively in English or translated from English, introducing linguistic bias into how LLMs are assessed on math tasks.
Read Original Article

Related Articles

Capgemini reports 7% first-quarter revenue growth at constant exchange rates, with generative and agentic AI now accounting for more than 10% of group bookings
Large Language Models

Capgemini reports 7% first-quarter revenue growth at constant exchange rates, with generative and agentic AI now accounting for more than 10% of group bookings

Yahoo Finance AI·Apr 30, 2026
AgentRQ, an open-source agent-human collaboration platform using Model Context Protocol, launches with real-time task management and Claude integration.
Large Language Models

AgentRQ, an open-source agent-human collaboration platform using Model Context Protocol, launches with real-time task management and Claude integration.

Hacker News·Apr 30, 2026
GitHub Copilot Student removes GPT-5.3-Codex from model picker, keeping it available through auto model selection
Large Language Models

GitHub Copilot Student removes GPT-5.3-Codex from model picker, keeping it available through auto model selection

Hacker News·Apr 30, 2026
Research paper argues that self-training in large language models leads to model collapse without external human-generated data
Large Language Models

Research paper argues that self-training in large language models leads to model collapse without external human-generated data

Hacker News·Apr 30, 2026
Large Language Models

OpenAI releases GPT-5.5 prompting guide emphasizing outcome-oriented instructions over process-heavy prompts

Hacker News·Apr 30, 2026

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free