ai · Built from scratch
ML from scratch
Perceptron, softmax regression, GDA and SGD with only NumPy
Project page: From-scratch implementations
- Stack
- NumPy and raw math
- Implemented
- Perceptron, softmax regression, Gaussian discriminant analysis, SGD
- Status
- Ongoing, still adding
This repo is my way of really understanding machine learning—by building everything from scratch. No scikit-learn, no TensorFlow, just NumPy and raw math. Writing these algorithms line by line forces me to truly get how they work, rather than just using them as black boxes.
So far, I’ve implemented models like Perceptron, Softmax Regression, Gaussian Discriminant Analysis, and Stochastic Gradient Descent (SGD). Each one is built with clarity in mind, making it easier to see what’s happening under the hood.
This is an ongoing project, and I keep adding new implementations as I explore more ML concepts. If you’re into machine learning and love breaking things down to their fundamentals, you might find this repo interesting. Check it out on GitHub!