AI

AI Engineer Academy

Transform Software Engineers into AI Engineers
Back to Academy
3
Cohort #1 • Post #3

How to Make a Chatbot

Learn the complete process of building modern chatbots like ChatGPT, from understanding transformer architecture to training with human feedback.

Learning Steps

1

Overview

Watch Andrej Karpathy's video, "Deep Dive into LLMs like ChatGPT", which covers all the steps that go into making a modern chatbot like ChatGPT.

Required Resources:

1
Deep Dive into LLMs like ChatGPT
2

Understand the Transformer Network Architecture

Read Jay Alammar's "The Illustrated Transformer" blog post that visually explains the Transformer neural network architecture.

Required Resources:

1
The Illustrated Transformer

Optional Resources:

The Annotated Transformer
3

Pre-train to get a base model, Post-train via Supervised Fine Tuning (SFT) and Reinforcement Learning with Human Feedback (RLHF) to get a chatbot aligned with human preferences

Read Sebastian Raschka's "LLM Training: RLHF and its Alternatives" blog post. Read and watch the video on Oxen.ai's "Training Language Models to Follow Instructions (InstructGPT)" blog post.

Required Resources:

1
LLM Training: RLHF and its Alternatives
2
Training Language Models to Follow Instructions (InstructGPT)

Optional Resources:

Training language models to follow instructions with human feedback (March 2022)

Live AMA Session

Date: Wednesday, October 15

Time: 9:30 am PST

Please reply below to get the Zoom link to the live AMA session. Bring your questions, discuss progress and connect with peers.

Published: 9/30/2024