Llama

https://github.com/hybridgroup/yzma Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration.

https://github.com/distantmagic/structured Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp