This tool works pretty well. https://github.com/fgsch/varnish3to4 - combined with the "whats changed" it should not take you much time to upgrade.