I'm having the same issue trying to compile the latest tflite-server from gitlab. I haven't even changed any code and it still did not build for qrb5165. It has multiple missing files such as modal_json.h, modal_pipe.h, c_api_internal.h, delegate.h, etc.
I copied and pasted the json and pipe headers from the libmodal repositories from voxl SDK/Code Libs on Gitlab and that fixed the first two. But still got the file not found error.