-
Notifications
You must be signed in to change notification settings - Fork 29
Expand file tree
/
Copy pathtutorials.qmd
More file actions
93 lines (70 loc) · 4.87 KB
/
Copy pathtutorials.qmd
File metadata and controls
93 lines (70 loc) · 4.87 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
---
title: "Comprehensive Tutorials"
page-layout: full
title-block-banner: true
---
## Deep-Dive Learning Materials
These comprehensive tutorials provide detailed mathematical foundations, worked examples, and extensive practice problems for core machine learning concepts. Each tutorial is designed to complement the lecture slides with in-depth explanations and hands-on exercises.
### Mathematical Foundations
Essential mathematical concepts that underlie all machine learning algorithms.
- [Mathematical Prerequisites](basics/tutorials/tutorial-0-prerequisites.pdf) - Scalars, vectors, matrices, norms, probability, and statistics
- [Accuracy Convention & ML Metrics](basics/tutorials/mathematical-conventions.pdf) - Performance evaluation, confusion matrices, and metric interpretation
### Core Algorithms
Detailed tutorials on fundamental machine learning algorithms.
- [Decision Trees](basics/tutorials/decision-trees.pdf) - Tree construction, pruning, information theory, and implementation
- [Cross-Validation](supervised/tutorials/cross-validation.pdf) - Model evaluation, hyperparameter tuning, and validation strategies
- [Linear Regression](supervised/tutorials/linear-regression.pdf) - Least squares, statistical properties, and regularization
- [Logistic Regression](supervised/tutorials/logistic-regression.pdf) - Classification, maximum likelihood, and interpretation
- [Ensemble Methods](supervised/tutorials/ensemble-methods.pdf) - Random forests, boosting, and model combination
- [K-Nearest Neighbors](supervised/tutorials/knn.pdf) - Instance-based learning and distance metrics
- [Support Vector Machines](supervised/tutorials/svm.pdf) - Margin maximization, kernels, and optimization
- [Bias-Variance Analysis](supervised/tutorials/bias-variance.pdf) - Model complexity and generalization trade-offs
- [Naive Bayes](supervised/tutorials/naive-bayes.pdf) - Probabilistic classification and Bayesian inference
- [Feature Selection](supervised/tutorials/feature-selection.pdf) - Variable selection and dimensionality reduction
- [Lasso Regression](supervised/tutorials/lasso-regression.pdf) - L1 regularization and sparse feature selection
- [Matrix Factorization](supervised/tutorials/matrix-factorization.pdf) - Collaborative filtering and recommendation systems
### Coming Soon
Additional tutorials are being developed for:
- **Neural Networks** - Multilayer perceptrons, backpropagation, and deep learning
- **Clustering** - K-means, hierarchical clustering, and dimensionality reduction
- **Optimization** - Gradient descent, convex optimization, and advanced methods
## Tutorial Features
Each tutorial includes:
- **Comprehensive Theory** - Mathematical foundations with intuitive explanations
- **Real-World Examples** - Practical applications with step-by-step solutions
- **Visual Learning** - Diagrams, plots, and geometric interpretations
- **Practice Problems** - Graded exercises from basic to advanced levels
- **Implementation Tips** - Practical guidance for coding and debugging
- **Best Practices** - Industry-standard approaches and common pitfalls
## How to Use These Tutorials
### For Self-Study
1. **Start with Prerequisites** - Ensure mathematical foundations are solid
2. **Follow Topic Sequence** - Build concepts progressively
3. **Work Through Examples** - Don't skip the worked examples
4. **Attempt All Problems** - Practice is essential for mastery
5. **Check Solutions** - Verify understanding with provided solutions
### For Instructors
- **Modular Design** - Each tutorial is self-contained
- **Flexible Pacing** - Can be split across multiple sessions
- **Assessment Ready** - Problems suitable for homework and exams
- **Complementary Materials** - Designed to work with lecture slides
### For Review
- **Comprehensive Reference** - Detailed coverage of each topic
- **Quick Lookup** - Well-organized with clear section headers
- **Formula Collection** - Key equations highlighted throughout
- **Conceptual Summaries** - Main ideas distilled at the end
## Prerequisites
- **Mathematics**: Linear algebra, calculus, probability, and statistics
- **Programming**: Basic Python knowledge helpful but not required
- **Software**: PDF reader for viewing tutorials
- **Time**: 2-4 hours per tutorial for thorough understanding
## Compilation Information
All tutorials are written in LaTeX and compiled to high-quality PDFs. The source files use consistent mathematical notation defined in our [conventions package](shared/styles/conventions.sty) to ensure coherence across all materials.
---
## Quick Navigation
- [Course Homepage](index.qmd) - Return to main page
- [Lecture Slides](slides.qmd) - Companion presentation materials
- [Interactive Notebooks](notebooks.qmd) - Hands-on coding examples
- [Instructor](https://nipunbatra.github.io) - Nipun Batra's homepage
## Feedback
Found an error or have suggestions? Please [open an issue](https://github.com/nipunbatra/ml-teaching/issues) on our GitHub repository.