I've been planning exactly what you describe in that second paragraph for creating videos for the music I make. It's a lot easier than doing it realtime, and because I make the music, I'm planning on doing it multi-track so I can put individual stems in.