Enigma: GPT-2 trained on 10K Nature Papers: Can you spot the difference?stefanzukin.com 183MrUssek5y105 comments
GShard: Scaling giant models with conditional computation and automatic shardingarxiv.org 112MrUssek6y35 comments