Nanogpt
원문: nanogpt
Educational GPT implementation in ~300 lines. Reproduces GPT-2 (124M) on OpenWebText. Clean, hackable code for learning transformers. By Andrej Karpathy. Perfect for understanding GPT architecture from scratch. Train on Shakespeare (CPU) or OpenWebText (multi-GPU).
무엇을 하나요
nanoGPT Minimalist GPT Training Quick start nanoGPT is a simplified GPT implementation designed for learning and experimentation. Installation : Train on Shakespeare (CPU friendly): Output : Common workflows Workflow 1: Character level Shakespeare Complete training pipeline : Config ( config/train shakespeare char.py ): Training time : ~5 minutes (CPU), ~1 minute (GPU) Workflow 2: Reproduce GPT 2 (124M) Multi GPU training on OpenWebText : Config ( config/train gpt2.py ): Training time : ~4 days (8× A100) Workflow 3: Fine tune pretrained GPT 2 Start from OpenAI checkpoint : Example config ( config/finetune shakespeare.py ): Workflow 4: Custom dataset Train on your own text : Train : When to u…
실행 시 본인 API 키(BYOK)로 동작하며, 모델 비용은 사용자 계정에서 직접 결제됩니다.