marialcasimiro/tatoeba-opus-2021-02-22-eng-fra

eng-fra

• source language name: English

• target language name: French

• OPUS readme: README.md

• model: transformer-align

• source language code: en

• target language code: fr

• dataset: opus

• release date: 2021-02-22

• pre-processing: normalization + SentencePiece (spm32k,spm32k)

• download original weights: opus-2021-02-22.zip

• Training data:

  • fra-eng: Tatoeba-train (180923857)

• Validation data:

  • eng-fra: Tatoeba-dev, 250098
  • total-size-shuffled: 249757
  • devset-selected: top 5000 lines of Tatoeba-dev.src.shuffled!

• Test data:

  • newsdiscussdev2015-enfr.eng-fra: 1500/27986
  • newsdiscusstest2015-enfr.eng-fra: 1500/28027
  • newssyscomb2009.eng-fra: 502/12334
  • news-test2008.eng-fra: 2051/52685
  • newstest2009.eng-fra: 2525/69278
  • newstest2010.eng-fra: 2489/66043
  • newstest2011.eng-fra: 3003/80626
  • newstest2012.eng-fra: 3003/78011
  • newstest2013.eng-fra: 3000/70037
  • Tatoeba-test.eng-fra: 10000/80769
  • tico19-test.eng-fra: 2100/64655

• test set translations file: test.txt

• test set scores file: eval.txt

• BLEU-scores

  Test set	score
  Tatoeba-test.eng-fra	50.8
  tico19-test.eng-fra	41.8
  newsdiscusstest2015-enfr.eng-fra	40.8
  newstest2011.eng-fra	34.6
  newsdiscussdev2015-enfr.eng-fra	33.9
  newstest2013.eng-fra	33.5
  newstest2010.eng-fra	33.0
  newstest2012.eng-fra	32.0
  newssyscomb2009.eng-fra	30.0
  newstest2009.eng-fra	29.9
  news-test2008.eng-fra	27.5

• chr-F-scores

  Test set	score
  Tatoeba-test.eng-fra	0.671
  newsdiscusstest2015-enfr.eng-fra	0.649
  tico19-test.eng-fra	0.638
  newstest2011.eng-fra	0.614
  newsdiscussdev2015-enfr.eng-fra	0.606
  newstest2010.eng-fra	0.599
  newstest2012.eng-fra	0.593
  newstest2013.eng-fra	0.591
  newssyscomb2009.eng-fra	0.587
  newstest2009.eng-fra	0.58
  news-test2008.eng-fra	0.556

System Info:

• hf_name: eng-fra
• source_languages: en
• target_languages: fr
• opus_readme_url: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-fra/opus-2021-02-22.zip/README.md
• original_repo: Tatoeba-Challenge
• tags: ['translation']
• languages: ['en', 'fr']
• src_constituents: ['eng']
• tgt_constituents: ['fra']
• src_multilingual: False
• tgt_multilingual: False
• helsinki_git_sha: 6faf2dab0b7b01a0e08a114dbacbb7deac54988d
• transformers_git_sha: e9a6c72b5edfb9561a981959b0e7c62d8ab9ef6c
• port_machine: 146-193-182-187.edr.inesc.pt
• port_time: 2023-11-08-11:42