You're probably not going to get totally away from significant rewrites. That being said, having independent build scripts (as in actual shell scripts) to run your pipelines would be helpful. This way you would just launch the script instead of rewriting everything in the CI's language of choice. Also making it as modular and well documented as possible helps.