Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
Collapse
Brand Logo

ModalAI Forum

  1. ModalAI Support Forum
  2. VOXL Compute & Autopilot
  3. VOXL 2
  4. voxl 2 Failed to appy GPU delegate

voxl 2 Failed to appy GPU delegate

Scheduled Pinned Locked Moved VOXL 2
4 Posts 3 Posters 942 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Viswanadh CheguV Offline
    Viswanadh CheguV Offline
    Viswanadh Chegu
    wrote on last edited by
    #1

    Hi @modaltb, @Chad-Sweet

    We are facing issue with our own tflite model deployed on voxl2 for text detection bounding boxes.
    Here we are seeing "Failed to apply GPU deligate".
    From our understanding it seems that model will run on CPU in this case. So we are seeing high inference latency of 7-8 seconds, which we want to minimize by running it on GPU.
    Can you please help use with this issue.

    PS: Our tflite model size is 41MB.

    Attaching snapshot from voxl2 run for reference.

    Thanks

    voxl-tflite-server.png

    1 Reply Last reply
    1
    • James StrawsonJ Offline
      James StrawsonJ Offline
      James Strawson
      ModalAI Team
      wrote on last edited by
      #2

      Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

      https://www.tensorflow.org/lite/performance/gpu

      Arjun Jain 0A Viswanadh CheguV 2 Replies Last reply
      1
      • James StrawsonJ James Strawson

        Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

        https://www.tensorflow.org/lite/performance/gpu

        Arjun Jain 0A Offline
        Arjun Jain 0A Offline
        Arjun Jain 0
        wrote on last edited by
        #3
        This post is deleted!
        1 Reply Last reply
        0
        • James StrawsonJ James Strawson

          Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

          https://www.tensorflow.org/lite/performance/gpu

          Viswanadh CheguV Offline
          Viswanadh CheguV Offline
          Viswanadh Chegu
          wrote on last edited by
          #4

          @James-Strawson Thanks for reply, Will look into it and get back.

          1 Reply Last reply
          0

          Hello! It looks like you're interested in this conversation, but you don't have an account yet.

          Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

          With your input, this post could be even better 💗

          Register Login
          Reply
          • Reply as topic
          Log in to reply
          • Oldest to Newest
          • Newest to Oldest
          • Most Votes


          ModalAI
          Categories Recent Tags ModalAI.com Docs
          © 2026 ModalAI® · Accelerating autonomy for smaller, smarter, safer drones · Powered by NodeBB
          • Login

          • Don't have an account? Register

          • Login or register to search.
          • First post
            Last post
          0
          • Categories
          • Recent
          • Tags
          • Popular
          • Users
          • Groups