phi-1[0] is only 1.3 billion parameters and performs very well in coding tasks - small models have a massive amount of potential

[0] - https://arxiv.org/abs/2306.11644