First keep in mind that quantum computers have not been proven to be more powerful than classical computers. Keep also in mind that "quantum computing", like "classical computing", is a mathematical model that exists outside of reality.

That said, I think the answer to your question is that the "test particle" in the pilot-wave model is always reaching its destination at the speed of light. If however you model the pilot wave with Newtonian physics and place a literal test particle in it, well, even if the particle is moving very fast, its meandering route will all but guarantee a much slower (likely asymptotically slower) traversal than the pilot-wave test particle.

But IANAP and welcome corrections.