Awesome Zig LLM ⚡ A curated list for AI & ML in Zig

Showcase
1

Hey everyone!

I was exploring the AI inference ecosystem recently and came across the awesome-rust-llm repo. When I went looking for a Zig equivalent, I realized we didn’t really have a dedicated hub for it yet. The main awesome-zig list is great, but the ML section is just scratching the surface.

So, I decided to create Awesome Zig LLM!

image
image936×756 56.6 KB

Zig is incredible for inference engines, tensor operations, and edge AI. I’ve seeded the repo with a few heavy hitters to get things started:

  • ZML (Production AI inference stack)

  • llm.zig(Saimirbaci’s clean port of Karpathy’s llm.c)

  • Z-Ant (Cross-platform edge NN deployment SDK)

Calling for Contributions:

I’m actively looking for PRs or links to:

  • Inference engines and model ports

  • Tensor & linear algebra libraries

  • Bindings & wrappers (llama.cpp, ONNX, Ollama)

  • Tokenizer implementations

  • Edge/embedded NN deployment tools

  • Learning resources (blog posts, tutorials, guides)

If you’re building something in this space or you know a project that deserves a spotlight drop a link here or open a PR. Every entry helps make this the go-to reference for Zig AI work.

Repo: GitHub - Andrew-Velox/awesome-zig-llm: ⚡ A curated list of awesome Large Language Model (LLM), Machine Learning, and AI projects, libraries, and resources built with the Zig programming language. · GitHub

4 Likes
2

I thought Zig had a pretty “Anti LLM“ stance?

1 Like
3

It does in the language itself, though I don’t know how far that extends into the ecosystem.

2 Likes
4

Aah I see!

5

People should use Zig as they see fit, the Zig compiler policy makes sense for the Zig compiler project and it’s likely that it does not make as much sense for other projects that don’t share most of its characteristics.

10 Likes