Ben Chuanlong Du's Blog

It is never too late to learn.

LLM in Rust

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://github.com/rustformers/llm llm is an ecosystem of Rust libraries for working with large language models - it's built on top of the fast, efficient GGML library for machine learning.

https://github.com/srush/llama2.rs

https://github.com/Atome-FE/llama-node

https://github.com/Noeda/rllama

Comments