Having a physics degree has really given me an unfair advantage as a software engineer.

You'll have to do some extra work (hint: if you haven't already, start coding in your spare time now, and endeavor to learn version control and unit testing). But the short answer is: yes, you will be able to compete.