NOTE: A graph line ending early just indicates an early convergence with training error

The goal of this Machine Learning Algorithm is to figure out the price of a car based off of different factors, such as model, make, year, etc.

Observing Differences Between Different Optimizers - Regression

Observing differences between learning rates

It looks like Adam generally does much better with lower learning rates and starts closer to the solution

It looks like SGD converges very slowly and starts far from converged loss

Adarad starts closest to the solution out of the other three but the problem is that it can take a long time to converge, more time than Adam in some cases