Implementing Regression With Gradient Descent From Scratch

This is the first post of an n-part series that involves implementing common Deep Learning architectures from scratch. The next post will be on CNNs and I’ll keep updating the links here as I progress through this project.

• Implementing Linear and Logistic Regression with Gradient Descent from Scratch (This post)
• Implementing a CNN for MNIST digit classification from Scratch (Upcoming)

I recently completed the Deep Learning Specialization from deeplearning.ai, and as usual with Coursera courses, I found myself inadequately prepared for implementing the knowledge in the real world.

While Coursera programming assignments had every student implement the same thing we’re…