Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Tips on nbconvert
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
-
Converting too many notebooks at the same (multiprocessing) causes
zmq.error.ZMQError: Address already in use. The simple way to fix this issue is to limit the number of processes converting …
Scaling Law for LLM
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Beyond neural scaling laws – Paper Explained
Scaling Laws refer to the observed trend of some machine learning architectures (notably transformers) to scale their performance on predictable power law when given more …
Retrieval-Augmented Generation for LLM
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
What is retrieval-augmented generation? https://research.ibm.com/blog/retrieval-augmented-generation-RAG
What is retrieval-augmented generation? @ YouTube https://www.youtube.com/watch?v=T-D1OfcDW1M
LLM and Robotics
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Awesome-LLM-Robotics https://github.com/GT-RIPL/Awesome-LLM-Robotics
Fine-Tune LLM
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
LoRA: Low-Rank Adaptation of Large Language Models
https://arxiv.org/abs/2106.09685