This repository provides a deep dive into the fundamentals of neural networks and machine learning, featuring two key resources:
- An Artificial Neural Network (ANN) implementation from scratch, inspired by the teachings of Guillaume from the MachineLearnia YouTube channel.
- A comprehensive slide deck (around 250 slides) crafted to explain the basics of machine learning, deep learning, and the gradient descent algorithm, designed independently for a deep learning course delivered to the Open Source Club.
- Custom Build: Implements an ANN entirely in Python without libraries like TensorFlow or PyTorch.
- Key Components:
- Forward propagation for calculating outputs.
- Backpropagation for learning via gradient descent.
- Activation functions such as sigmoid and ReLU.
- Loss function computation, including Mean Squared Error.
- Learning-Oriented Design: Step-by-step code and explanations to help beginners grasp neural network mechanics.
- Educational Focus: Introduces machine learning and deep learning concepts in an easy-to-follow format.
- Gradient Descent Explained: Thorough coverage of the gradient descent algorithm, its mathematical foundation, and its role in optimization.
- Standalone Resource: The slides stop at gradient descent and do not delve into forward or backward propagation.
- Independent Creation: These slides were developed solely by the author to support the Open Source Club’s educational goals.
- Python 3.x
- Required libraries:
numpy
matplotlib
(optional, for visualization)sklearn
tqdm
Install the necessary libraries using pip:
pip install numpy matplotlib
pip install numpy sklearn
pip install numpy tqdm
pip install numpy numpy
- Download or clone the repository.
- Open the Jupyter Notebook (
ANN_from_scratch.ipynb
) in a Jupyter environment. - Run the cells sequentially to understand and execute the code.
- The ANN implementation is inspired by the work of Guillaume from MachineLearnia.
- The slides are the original work of the repository author. Their use, reproduction, or distribution without explicit permission is strictly prohibited.
- Special thanks to Guillaume from MachineLearnia for the inspiration and guidance on the ANN implementation.
- Gratitude to the Open Source Club for the opportunity to present the educational course where these slides were used.
This project is open-source under the MIT License, except for the slide deck, which requires explicit permission for use.
For any questions or suggestions, feel free to reach out!