Ben Chuanlong Du's Blog

It is never too late to learn.

Scaling Law for LLM

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Beyond neural scaling laws – Paper Explained

Scaling Laws refer to the observed trend of some machine learning architectures (notably transformers) to scale their performance on predictable power law when given more …

Retrieval-Augmented Generation for LLM

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

What is RAG

What is retrieval-augmented generation? https://research.ibm.com/blog/retrieval-augmented-generation-RAG

What is retrieval-augmented generation? @ YouTube https://www.youtube.com/watch?v=T-D1OfcDW1M

LLM and Robotics

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Awesome-LLM-Robotics https://github.com/GT-RIPL/Awesome-LLM-Robotics

Fine-Tune LLM

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

LoRA: Low-Rank Adaptation of Large Language Models

https://arxiv.org/abs/2106.09685

Tips on Shuttle for Deploying Rust Apps

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Shuttle is a Rust-native cloud development platform that lets you deploy your Rust apps for free. Shuttle uses traits and annotations to configure your backend deployment - including databases.

References

Rust Backend Frameworks for Rest APIs

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

axum

axum Ergonomic and modular web framework built with Tokio, Tower, and Hyper axum is a web application framework that focuses on ergonomics and modularity.

Actix

Actix Web is a powerful …