Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
Collapse
Brand Logo

ModalAI Forum

  1. ModalAI Support Forum
  2. VOXL 2 and VOXL 2 Mini
  3. voxl 2 Failed to appy GPU delegate

voxl 2 Failed to appy GPU delegate

Scheduled Pinned Locked Moved Unsolved VOXL 2 and VOXL 2 Mini
voxl-2
4 Posts 3 Posters 1.0k Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Viswanadh CheguV Offline
    Viswanadh CheguV Offline
    Viswanadh Chegu
    wrote on last edited by
    #1

    Hi @modaltb, @Chad-Sweet

    We are facing issue with our own tflite model deployed on voxl2 for text detection bounding boxes.
    Here we are seeing "Failed to apply GPU deligate".
    From our understanding it seems that model will run on CPU in this case. So we are seeing high inference latency of 7-8 seconds, which we want to minimize by running it on GPU.
    Can you please help use with this issue.

    PS: Our tflite model size is 41MB.

    Attaching snapshot from voxl2 run for reference.

    Thanks

    voxl-tflite-server.png

    1 Reply Last reply
    1
    • James StrawsonJ Offline
      James StrawsonJ Offline
      James Strawson
      ModalAI Team
      wrote on last edited by
      #2

      Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

      https://www.tensorflow.org/lite/performance/gpu

      Arjun Jain 0A Viswanadh CheguV 2 Replies Last reply
      1
      • James StrawsonJ James Strawson

        Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

        https://www.tensorflow.org/lite/performance/gpu

        Arjun Jain 0A Offline
        Arjun Jain 0A Offline
        Arjun Jain 0
        wrote on last edited by
        #3
        This post is deleted!
        1 Reply Last reply
        0
        • James StrawsonJ James Strawson

          Models must contain only instructions from a limited set and be quantized properly to run on the GPU. Please refer to the TensorFlow docs for details:

          https://www.tensorflow.org/lite/performance/gpu

          Viswanadh CheguV Offline
          Viswanadh CheguV Offline
          Viswanadh Chegu
          wrote on last edited by
          #4

          @James-Strawson Thanks for reply, Will look into it and get back.

          1 Reply Last reply
          0

          Reading along? Create a free ModalAI Forum account to join in.

          With an account you can reply, ask your own question, get an email when a ModalAI engineer answers, and mark the reply that solved it. Your place in each thread is saved between visits.

          Questions about VOXL, Flight Core, ESCs and ModalAI drones are answered here by the engineers who build them.

          Register Login
          Reply
          • Reply as topic
          Log in to reply
          • Oldest to Newest
          • Newest to Oldest
          • Most Votes


          ModalAI
          Categories Recent Tags ModalAI.com Docs
          © 2026 ModalAI® · Accelerating autonomy for smaller, smarter, safer drones · Powered by NodeBB
          • Login

          • Don't have an account? Register

          • Login or register to search.
          • First post
            Last post
          0
          • Categories
          • Recent
          • Tags
          • Popular
          • Users
          • Groups