rasbt

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Star
107k
全站累计
Fork17k衍生分支贡献
语言Jupyter Notebook核心开发语言
创建于2023-07-23已运营 3.3 年
最近推送2026-10-02最新代码提交

Star 走势

已连续追踪 69 天每日快照数据

期间增长:+19k (20.8%)
89k98k107k2026-04-062026-09-252026-10-29
GitHub 官方 Topics:
#ai#artificial-intelligence#attention-mechanism#deep-learning#finetuning#from-scratch#generative-ai#gpt#instruction-tuning#language-model#large-language-models#llm#machine-learning#natural-language-processing#pretraining#python#pytorch#tokenizer#transformers