Metric & Benchmark
BLEU
N-gram-overlap metric for machine-translation quality versus reference translations.
Definition
BLEU (Bilingual Evaluation Understudy) computes the geometric mean of n-gram precisions between a candidate translation and one or more references, with a brevity penalty. It correlates moderately with human judgment on translation and remains a standard MT metric despite its limitations.
Common use cases
- Machine translation
- Summarisation eval
- Paraphrasing