Abstract

  • 2.6B parameter
  • Public domain social media conversations
  • SSA (Sensibleness and Specificity Average)
  • Some open-domain chatbots such as MILABOT (Ser-ban et al., 2017), XiaoIce (Zhou et al., 2018)1,Gunrock (Chen et al., 2018), Mitsuku (Wor-swick, 2018)2and Cleverbot3(by Rollo Carpen-ter) display human-like attributes, but rely on com-plex frameworks, such as dialog managers.
  • Mostly not useful since just have vague conversations.
  • 40 B mined and filtered from public domain conversations.
  • Seq2Seq + Evolved Transformer