voxl 2 Failed to appy GPU delegate

Viswanadh Chegu

We are facing issue with our own tflite model deployed on voxl2 for text detection bounding boxes.
Here we are seeing "Failed to apply GPU deligate".
From our understanding it seems that model will run on CPU in this case. So we are seeing high inference latency of 7-8 seconds, which we want to minimize by running it on GPU.
Can you please help use with this issue.

PS: Our tflite model size is 41MB.

Attaching snapshot from voxl2 run for reference.

Thanks

James Strawson

Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

https://www.tensorflow.org/lite/performance/gpu

Arjun Jain 0

This post is deleted!

Viswanadh Chegu

@James-Strawson Thanks for reply, Will look into it and get back.