75FreeIndexed/ ai-tools

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

105.6k stars67 contributorsupdated 3d agorasbt/LLMs-from-scratch

About

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Topics: ai, artificial-intelligence, attention-mechanism, deep-learning, finetuning, from-scratch, generative-ai, gpt, instruction-tuning, language-model, large-language-models, llm, machine-learning, natural-language-processing, pretraining, python, pytorch, tokenizer, transformers

Tags

aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

GitHub signals

Indexed
stars
105.6k
forks
16.2k
contributors
67
last commit
3d ago
Verify on GitHub

Details

Category
AI Tools
Type
AI tool
Pricing
Open source
Visit
amzn.to

Stack

Jupyter Notebookaiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

Engagement

claps
0
views
0

Similar tools