notes

on ai that worth sharing


Unifying Long Context LLMs and RAG

towards advances on long context LLMs and RAG

4 min read   ·   2024

Basic and Advanced Techniques on RAG

detailed techniques on RAG, with LangChain code examples

24 min read   ·   2024

Mixed-precision training in LLM

a note on mixed-precision training

7 min read   ·   2024

Understanding tokenizer from Andrej Karpathy's tutorial

a detailed note on llm tokenizer

19 min read   ·   2024