Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelismgithub.com/sail-sg 4 pointsyzh2 years ago2 commentsSaveHideCopy link On HNComments−ufotalent2yAn interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...−QPHutu2yCool!
Comments
An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...
Cool!