Skip to main content

Spring Deadline: Sunday, March 1 @ 11:59pm PT. Click here to apply.

Back to Research
Accepted to Attribution @ NeurIPS 2024

Translation Bias and Accuracy in Multilingual LLMs for Cross-Language Claim Verification

Aryan Singhal, Veronica Shao, Gary Sun, Ryan Ding

Abstract

We investigate systematic biases in neural machine translation (NMT) systems when translating text between languages with different cultural contexts. Our analysis reveals that NMT systems often produce translations that reflect the dominant cultural perspectives present in their training data, leading to subtle but significant meaning shifts. We propose a framework for measuring and mitigating these translation biases, introducing metrics that capture semantic drift across cultural dimensions. Experiments on 15 language pairs demonstrate the prevalence of these biases and the effectiveness of our debiasing approaches.

Citation

Aryan Singhal, Veronica Shao, Gary Sun, Ryan Ding. "Translation Bias and Accuracy in Multilingual LLMs for Cross-Language Claim Verification". Accepted to Attribution @ NeurIPS 2024.

Details

Conference
Accepted to Attribution @ NeurIPS 2024
Authors
4 authors

Publish Your Research

Join Algoverse and work with world-class mentors to publish at top AI conferences.

Start Your Application