Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

• llm

  llm is an ecosystem of Rust libraries for working with large language models - it's built on top of the fast, efficient GGML library for machine learning.

• llama2.rs

• ollama-rs

  A simple and easy-to-use library for interacting with the Ollama API.

• llama-node

• rllama

• rust-bert

• Swiftide

  Swiftide is a Rust library for building LLM applications, enabling fast data ingestion, transformation, and indexing for effective querying and prompt injection, known as Retrieval Augmented Generation. It provides flexible building blocks for creating various agents, allowing rapid development from concept to production with minimal code.

• async-openai async-openai is an unofficial Rust library for OpenAI.