Mathematica programming language is somewhat symbolic, like Lisp; so you could just "rewrite" your expressions to use CUDAfft[] or whatever very easily.

Example:

  Hold[Times[1,2]] /. (Times -> Plus)