> the software has to be compiled to the architecture too using that solution

Right. Which is why Debian has a package management system. Most people never have to compile any of the software they use.