Autoplay
Autocomplete
Previous Lesson
Complete and Continue
CustomGPT Course
Introduction
Course Introduction (3:11)
Prerequisites (2:13)
Transformers and GPT Models (11:24)
Dataset
How to Find a Dataset (4:15)
Load Dataset into Python (5:11)
Tokenization Implementation (6:54)
Encode and Decode Tokens (3:04)
Load the Dataset into Tensors with PyTorch (6:54)
Model Inputs and Targets (6:28)
Dataset Batches (8:12)
GPT Architecture Implementation
Architecture Setup (8:58)
Attention Head for Self-Attention (11:52)
Feed Forward and Layer Normalization (8:14)
Transformer Block (7:02)
Tiny Language Model Setup (8:08)
Forward Method (6:17)
Generate Method & Model Instance (11:49)
Tiny Language Model Training & Data Generation
Loss Function & Optimizer (5:00)
Training Loop Implementation (7:39)
Generate New Text from Trained Model (7:12)
CustomGPT Web Application
Setup Streamlit Web App & Dataset (6:59)
Model Implementation in Web App (9:26)
Training Tiny Language Model in Web App (6:20)
Web Application Demo & Different Datasets (7:26)
Course Outro (2:21)
Model Inputs and Targets
Lesson content locked
If you're already enrolled,
you'll need to login
.
Enroll in Course to Unlock