Artificial Intelligence Index

Notes and resources on AI, Machine Learning, and related sub-domains.

Fundamentals Important Terms and Concepts

Definition of machine learning
Learning paradigms (Supervised learning, Unsupervised learning, Semi-supervised learning, Self-supervised learning, Reinforcement learning)
Prediction vs inference
Parametric models, Non-parametric models
Model parameters
Hyperparameters
Training data, Validation data
Test data
Generalization
Overfitting, Underfitting
Bias, Variance
Bias-variance tradeoff
Irreducible error
Data leakage
Distribution shift
Concept drift