Try to improve the situation. Software development is all about team work, and skills and experience in developing the development are appreciated. If you can tell in your CV that I made this and that improvement, I would consider it a great plus. CS degree also sounds like a good idea (I'm in Finland, don't know about scene there).

If it does not work out, you can always look for a new place.