<![CDATA[Voxl Pytorch Support]]>Hey,
Pytorch supports by default CUDA(Nvidia Gpu) devices, but VOXL has a Qualcomm Adreno 530 wich is a AMD Gpu. In the Pytorch Docs there is also a Support for AMD Gpu´s with Rocm. Does anybody know if it's possible to use Rocm on Voxl or another way to enable GPU for Pytorch?
PS. I know Modal AI has a tflite Server for tensorflow Models but we already have a Model trained on Pytorch and Inference with CPU is to slow.

]]>https://forum.modalai.com/topic/706/voxl-pytorch-supportRSS for NodeWed, 19 Aug 2026 20:13:56 GMTThu, 03 Feb 2022 10:02:43 GMT60<![CDATA[Reply to Voxl Pytorch Support on Mon, 07 Feb 2022 05:46:38 GMT]]>Thank you for your Answer yeah i will definitely look into using Tensorflow Lite

]]>https://forum.modalai.com/post/3294https://forum.modalai.com/post/3294Mon, 07 Feb 2022 05:46:38 GMT<![CDATA[Reply to Voxl Pytorch Support on Fri, 04 Feb 2022 18:22:41 GMT]]>@Philemon-Benner In the tflite-server, we use the OpenCL backend to enable GPU support. However, according to a pytorch dev, "As Tensorflow already tentatively supports OpenCL, albeit through a proprietary compiler framework, it looks like Tensorflow is the way to go for anyone with an AMD card or, er, any CPU."

That said, it may be a bit easier to convert your pytorch model over to a tflite model that can run with gpu acceleration. A good resource for this process is this repo, and if you are interested in some other tflite models this model zoo has many preconverted options.

If you were to follow this conversion process, be sure to read up on this section in our documentation!

]]>https://forum.modalai.com/post/3268https://forum.modalai.com/post/3268Fri, 04 Feb 2022 18:22:41 GMT<![CDATA[Reply to Voxl Pytorch Support on Thu, 03 Feb 2022 17:20:11 GMT]]>Thank you for your fast response. Good to know that...

]]>https://forum.modalai.com/post/3250https://forum.modalai.com/post/3250Thu, 03 Feb 2022 17:20:11 GMT<![CDATA[Reply to Voxl Pytorch Support on Thu, 03 Feb 2022 16:58:27 GMT]]>@Philemon-Benner This doesn't answer your question, but Adreno is a GPU designed by Qualcomm, not AMD.

]]>https://forum.modalai.com/post/3248https://forum.modalai.com/post/3248Thu, 03 Feb 2022 16:58:27 GMT