Gradient Descent

Gradient Descent for 1 Variable

Starting point θ₀

θ₀ = -3

θ₀ = 4

θ₀ = 0.5

Learning rate ε

Gradient Descent for 2 Variables

Starting point (θ₁, θ₂)

(-3, -2)

(4, 3)

(0, 3)

Learning rate ε

Gradient Descent for Linear Regression

Starting point (β₁, β₂)

(0, 0)

(3, 0)

(-1, -4)

Learning rate ε