writing and calling an entire python setup seems massive overkill, surely just have an internal way of calling a simple calculator function would be millions of times faster
Probably but the cost of running a short lived python interpreter to run "print (100 + 200)" is likely negligable compared to the cost of running the language model itself
Comments
I assumed it wrote Python or some sort of other code.
writing and calling an entire python setup seems massive overkill, surely just have an internal way of calling a simple calculator function would be millions of times faster
Probably but the cost of running a short lived python interpreter to run "print (100 + 200)" is likely negligable compared to the cost of running the language model itself
Usually yes