Yolo Ultralytics stopped exporting fp16 tflite format. Can tflite-server directly handle fp32.tflite models?
-
Hey ModalAI,
Your documentation on custom inference using voxl-tflite-server is quite outdated. Yolo Ultralytics has stopped exporting frozen graph model format to tflite fp16 quantization. Ultralytics says there's no quantize=16 option — an FP32 .tflite model automatically runs in FP16 at runtime when using a GPU delegate (WebGPU/OpenCL/Metal), so a separate FP16 export file isn't needed. That's why half=True/quantize=16 throws the assertion.
Can voxl-tflite-server automatically execute FP32 models internally in FP16?
Hardware: VOXL2
Source code: Latest voxl-tflite-server code on modalai gitlab page.
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login