WMT 2011 News Crawl 机器翻译数据免费

JSAI 25 2021-08-24 NLP

资源介绍

WMT 2011 News Crawl 机器翻译数据 (http://ds.jsai.org.cn/) NLP 第1张

WMT 2011 News Crawl data 是一个自然语言翻译数据，从 Europarl corpus 语料中提取得到，包括：French-English、Spanish-English、German-English、Czech-English 语言对之间对应的文字描述。

提供的数据主要取自Europarl语料库的版本6。访问Europarl网站获取源代码版本。

其他培训数据来自新的新闻评论语料库。Europarl语料库的每种语言大约有4500万个单词的培训数据，而News Commentary语料库的大约200万个单词。
WMT 2011 News Crawl 机器翻译数据 (http://ds.jsai.org.cn/) NLP 第2张

END
上一篇
下一篇

发表评论

会员价:￥0推荐
原价:￥0
暂无演示 登录下载
登录

最新文章

更多>

热门文章

更多>

MIMIC-III（"重症监护医疗信息市场"）

2021-08-24 163

QASC: A Dataset for Question Answering via Sentence CompositionComposing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition(QASC), that requires retrieving facts from a large corpus and composing them to answer a multiple-choice question. QASC is the first dataset to offer two desirable properties: (a) the facts to be composed are annotated in a large corpus, and (b) the decomposition into these facts is not evident from the question itself. The latter makes retrieval challenging as the system must introduce new concepts or relations in order to discover potential decompositions. Further, the reasoning model must then learn to identify valid compositions of these retrieved facts using common-sense reasoning. To help address these challenges, we provide annotation for supporting facts as well as their composition. Guided by these annotations, we present a two-step approach to mitigate the retrieval challenges. We use other multiple-choice datasets as additional training data to strengthen the reasoning model. Our proposed approach improves over current state-of-the-art language models by 11% (absolute). The reasoning and retrieval problems, however, remain unsolved as this model still lags by 20% behind human performance.

2021-08-24 146

Yahoo!从公开可用网页中提取元数据

2021-08-24 89

RyanSpeech: A Corpus for Conversational Text-to-Speech Synthesis

2021-08-24 75

The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain

2021-08-24 75

标签云

猜你喜欢

MIMIC-III（"重症监护医疗信息市场"）
QASC: A Dataset for Question Answering via Sentence CompositionComposing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition(QASC), that requires retrieving facts from a large corpus and composing them to answer a multiple-choice question. QASC is the first dataset to offer two desirable properties: (a) the facts to be composed are annotated in a large corpus, and (b) the decomposition into these facts is not evident from the question itself. The latter makes retrieval challenging as the system must introduce new concepts or relations in order to discover potential decompositions. Further, the reasoning model must then learn to identify valid compositions of these retrieved facts using common-sense reasoning. To help address these challenges, we provide annotation for supporting facts as well as their composition. Guided by these annotations, we present a two-step approach to mitigate the retrieval challenges. We use other multiple-choice datasets as additional training data to strengthen the reasoning model. Our proposed approach improves over current state-of-the-art language models by 11% (absolute). The reasoning and retrieval problems, however, remain unsolved as this model still lags by 20% behind human performance.
Yahoo!从公开可用网页中提取元数据
The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain
RyanSpeech: A Corpus for Conversational Text-to-Speech Synthesis
Chinese handwritten digits MNIST dataset
博客作者身份语料库
通过安装残余物来在自然语言推理中未学习数据集偏差
济州岛数据集用于机器翻译和语音合成
Yahoo! Answers Comprehensive Questions and Answers