论文标题

现代法国诗歌一代与罗伯塔和GPT-2

Modern French Poetry Generation with RoBERTa and GPT-2

论文作者

Hämäläinen, Mika, Alnajjar, Khalid, Poibeau, Thierry

论文摘要

我们为法语中的现代诗歌产生了一种新颖的神经模型。该模型由两个预审预定的神经模型组成,这些模型是针对诗歌生成任务进行微调的。该模型的编码器是基于罗伯塔的编码器,而解码器基于GPT-2。这样,模型就可以受益于罗伯塔(Roberta)的优质自然语言表现以及GPT-2的良好自然语言生成表现。我们的评估表明,该模型可以成功创造法国诗歌。以5分的比例,人类法官对输出诗的典型性和情感性给出了最低的3.57分数,而最佳分数为3.79。

We present a novel neural model for modern poetry generation in French. The model consists of two pretrained neural models that are fine-tuned for the poem generation task. The encoder of the model is a RoBERTa based one while the decoder is based on GPT-2. This way the model can benefit from the superior natural language understanding performance of RoBERTa and the good natural language generation performance of GPT-2. Our evaluation shows that the model can create French poetry successfully. On a 5 point scale, the lowest score of 3.57 was given by human judges to typicality and emotionality of the output poetry while the best score of 3.79 was given to understandability.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源