A comprehensive repository for my Deep Learning study, implementation, and practice projects.
This includes lecture materials, theoretical notes, resources, self-implemented models, and hands-on notebooks to build strong fundamentals and practical skills in Deep Learning.
This repository contains:
Notes, slides, and code from theory sessions. Includes key concepts of neural networks, learning algorithms, activation functions, loss functions, optimization techniques, etc.
Theoretical notes based on CS299 or related foundational Deep Learning courses.
General resources, articles, external links, and cheatsheets that helped during study.
Assignment solutions for practice problems and coursework.
Advanced exercises and implementations using NumPy to build deep understanding of vectorization and manual tensor operations.
My own implementations of core deep learning models from scratch (e.g., Perceptron, MLP, Backpropagation, etc.).
DeepLearning/
│
├── LectureMaterial/
├── andrew-ng-CS299(Thoritical)-Notes-material/
├── Resource/
├── asg_sols/
├── numpy-advance/
├── self_implementation/
├── .gitignore
├── README.md
Here are some of the key implementations (expand later with links & descriptions):
✔ Perceptron
✔ Multi-Layer Perceptron (MLP)
✔ Activation functions (ReLU, Sigmoid, Tanh)
✔ Forward & Backward propagation manually
✔ Loss functions (MSE, Cross-entropy)
✔ Training loops & weight optimization
✔ Batch normalization
✔ Dropout
✔ Regularization techniques
The following tools and libraries are used across projects and notebooks:
| Library | Usage |
|---|---|
| Python | Core language |
| NumPy | Core mathematical operations |
| Matplotlib / Seaborn | Visualization |
| Jupyter Notebook | Interactive experiments |
| Scikit-Learn | Data preprocessing & metrics |
| TensorFlow / PyTorch | Deep learning frameworks (future projects) |
This study is primarily based on:
🎓 Online NPTEL Deep Learning course – IIT Ropar concepts, models, and assignments 📚 Other online resources & research articles (to be added by you)
- Explore folders based on topics.
- Open relevant Jupyter Notebooks to understand implementations.
- Use the code as templates for further experimentation.
- Try to re-implement models from scratch to improve fundamentals.
✔ Sequential models (RNNs, LSTMs, GRUs)
✔ Attention Mechanisms & Transformers
✔ Practical applications (Vision, NLP)
✔ PyTorch end-to-end projects