75FreeIndexed/ ai-tools

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

100.1k stars67 contributorsupdated 2d agorasbt/LLMs-from-scratch

About

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Topics: ai, artificial-intelligence, attention-mechanism, deep-learning, finetuning, from-scratch, generative-ai, gpt, instruction-tuning, language-model, large-language-models, llm, machine-learning, natural-language-processing, pretraining, python, pytorch, tokenizer, transformers

Tags

aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

GitHub signals

Indexed
stars
100.1k
forks
15.4k
contributors
67
last commit
2d ago
Verify on GitHub

Details

Category
AI Tools
Type
AI tool
Pricing
Open source
Visit
amzn.to

Stack

Jupyter Notebookaiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

Engagement

claps
0
views
0

Similar tools