AI

AI Engineer Academy

Transform Software Engineers into AI Engineers
Back to Academy
2
Cohort #1 • Post #2

Prompt Engineering, RAG, Evaluation Frameworks

Master the fundamentals of prompt engineering, retrieval-augmented generation, and evaluation methodologies.

Learning Steps

1

Prompt Engineering

Read and/or watch the videos on "The Prompt Report Parts 1 and 2" from Oxen.ai and read OpenAI's guidelines for text generation and prompting.

Required Resources:

1
The Prompt Report Part 1
2
The Prompt Report Part 2
3
OpenAI Text Generation Guidelines

Optional Resources:

The Prompt Report: A Systematic Survey of Prompt Engineering Techniques (June 2024)
2

Retrieval Augmented Generation (RAG)

Read LangChain's overview on RAG, implement their tutorial on building a search engine over a PDF document, and read Cameron Wolfe's practitioner's guide.

Required Resources:

1
LangChain RAG Overview
2
LangChain PDF Search Tutorial
3
Practitioner's Guide to RAG

Optional Resources:

RAG for Knowledge-Intensive NLP Tasks (May 2020)
3

Evaluation

Read about RAG evaluation metrics and learn about RAGAS framework for automated evaluation of RAG systems.

Required Resources:

1
RAG Evaluation Metrics Explained
2
RAGAS - Retrieval Augmented Generation Assessment

Optional Resources:

RAGAS: Automated Evaluation of RAG (Sep 2023)
Evaluation of RAG: a Survey (May 2024)

Live AMA Session

Date: Wednesday, July 16

Time: 9:30 am PST

Please reply below or DM me to get the Zoom link to the live AMA session. Bring your questions, discuss progress and connect with peers.

Published: 6/30/2024