ERNIE-GEN (large)
BaiduLanguage modelingLanguage modeling/generationText summarizationChatOpen weights
ERNIE-GEN (large) is language modeling model published by Baidu in 2020 featuring 340000000.0 parameters.
About ERNIE-GEN (large)
Current pre-training works in natural language generation pay little attention to the problem of exposure bias on downstream tasks. To address this issue, we propose an enhanced multi-flow sequence to sequence pre-training and fine-tuning framework n
Details
- Provider
- Baidu
- Task
- Language modeling,Language modeling/generation,Text summarization,Chat
- Parameters
- 340000000.0
- Released
- 2020-08-06
- Open weights
- Yes