Comment on AITemplate, a revolutionary new inference engine by Meta AIparentComments−papersnake3yHave you tested this on big models involving multi-gpu communication, or any plans?−ipiszy3yFor now it's for single GPU inference only.
Comments
Have you tested this on big models involving multi-gpu communication, or any plans?
For now it's for single GPU inference only.