Gen AI Core Concepts

212 Concepts to Master Gen AI Engineering

Comprehensive collection covering LLMs, RAG, prompt engineering, vector databases, fine-tuning, Python for AI, MLOps, agents, safety, and more.

Showing 212 concepts

#1Hardgen-ai-fundamentals

Explain the Transformer architecture. What are attention mechanisms and why are they important?

gen-aitransformersattention

View Details →

#2Mediumgen-ai-fundamentals

What's the difference between a Large Language Model (LLM) and other ML models?

gen-aillm

View Details →

#3Mediumgen-ai-fundamentals

Explain these LLM concepts: Tokens, Context window, Temperature & Top-p sampling, Beam search.

gen-aillmtokens

View Details →Code

#4Mediumgen-ai-fundamentals

What's the difference between encoder-only, decoder-only, and encoder-decoder models?

gen-aitransformersllm

View Details →Code

#5Hardgen-ai-fundamentals

Explain quantization in LLMs. Why is it important?

gen-aiquantizationllm

View Details →Code

#6Mediumgen-ai-fundamentals

What's the difference between fine-tuning and prompt engineering?

gen-aifine-tuningprompt-engineering

View Details →Code

#7Mediumgen-ai-fundamentals

Explain RAG. When would you use it over fine-tuning?

gen-airagfine-tuning

View Details →Code

#8Hardgen-ai-fundamentals

Walk me through a RAG pipeline architecture.

gen-airagsystem-design

View Details →Code

#9Hardgen-ai-fundamentals

How would you evaluate RAG system performance?

gen-airagevaluation

View Details →CodeResources

#10Hardgen-ai-fundamentals

What are common failure modes in RAG systems?

gen-airag

View Details →Code

#11Hardgen-ai-fundamentals

What's the difference between LoRA and full fine-tuning?

gen-aifine-tuninglora

View Details →Code

#12Hardgen-ai-fundamentals

Explain instruction tuning. Why is it important for chat models?

gen-aifine-tuningllm

View Details →Code

#13Mediumgen-ai-fundamentals

What metrics would you track during model training?

gen-aimlopstraining

View Details →Code

#14Mediumgen-ai-fundamentals

How would you handle imbalanced training data for a classification task?

gen-aitrainingmlops

View Details →Code

#15Mediumgen-ai-fundamentals

Explain chain-of-thought (CoT) prompting. Why does it work?

gen-aiprompt-engineering

View Details →Code

#16Mediumgen-ai-fundamentals

What's few-shot vs. zero-shot prompting?

gen-aiprompt-engineering

View Details →Code

#17Mediumgen-ai-fundamentals

Design a prompt for sentiment analysis. What could go wrong?

gen-aiprompt-engineering

View Details →Code

#18Hardgen-ai-fundamentals

What's prompt injection? How do you mitigate it?

gen-aiprompt-engineeringsecurity

View Details →Code

#19Mediumpython-for-gen-ai

Explain decorators in Python. How would you use them in an LLM application?

gen-aipython

View Details →Code

#20Mediumpython-for-gen-ai

What are context managers? How would you use them for LLM resource management?

gen-aipython

View Details →Code

Suggest a Concept

Connect with me on LinkedIn for queries, suggestions, or to support this project. If you come across Gen AI concepts not covered here, please share them so I can add them and keep this resource up-to-date for everyone!

Connect on LinkedIn