Tflight server multiple model

[Tamas Pal 0]

Please share the configuration file (voxl-tflite-server.conf) to run multiple models together

[A Former User]

Hey @Tamas-Pal-0,

Have you read through the docs here: https://docs.modalai.com/voxl-tflite-server/#running-multiple-models?

Basically, you start an instance of the tflite-server, then re-edit the config file and start the next instance...and so on.

Here is an example of what the first instance's config file could be:

/**
{
        "skip_n_frames":        0,
        "model":        "/usr/bin/dnn/yolov5_float16_quant.tflite",
        "input_pipe":   "/run/mpa/stereo/",
        "delegate":     "gpu",
        "allow_multiple":       true,
        "output_pipe_prefix":   "yolo"
}

After the first model is running, I edited the config to this for second instance:

{
        "skip_n_frames":        0,
        "model":        "/usr/bin/dnn/fastdepth_float16_quant.tflite",
        "input_pipe":   "/run/mpa/stereo/",
        "delegate":     "gpu",
        "allow_multiple":       true,
        "output_pipe_prefix":   "fastdepth"
}

The, I started up another tflite-server via the cmd line.
Output of both running:

[Tamas Pal 0]

@Matt-Turi Thanks !!