Comment on How has DeepSeek improved the Transformer architecture?parentComments−WithinReason1yThere is a big difference between inventing a technique and productising it.−anonymousDan1yOne issue is that a lot of techniques proposed (especially from academic research) are hard to validate at scale given the resources required. At least DeepSeek helps a little in that regard.
Comments
There is a big difference between inventing a technique and productising it.
One issue is that a lot of techniques proposed (especially from academic research) are hard to validate at scale given the resources required. At least DeepSeek helps a little in that regard.