Research Resouces

LLM Reasoning Papers

• LM Post-Training: A Deep Dive into Reasoning
  • https://arxiv.org/pdf/2502.21321
• A Tutorial on LLM Reasoning: Relevant Methods behind ChatGPT o1
  • https://arxiv.org/html/2502.10867v1
• Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learning
  • https://arxiv.org/html/2502.14768v1

LLM Research Blogs

• LLM Research Newsletter
  • https://www.llmsresearch.com/
• Transformer Circuit thread
  • https://transformer-circuits.pub/

Internals

• Pytorch Internals
  • https://blog.ezyang.com/2019/05/pytorch-internals/
• Transformer Internals
  • https://goyalpramod.github.io/blogs/Transformers_laid_out/#coding-the-transformer

ICLR BLog Posts

• A New Alchemy: Language Model Development as a Subfield?
  • https://iclr-blogposts.github.io/2024/blog/language-model-development-as-a-new-subfield/
• Fairness in AI: two philosophies or just one?
  • https://iclr-blogposts.github.io/2024/blog/fairness-ai-two-phil-or-just-one/