Starting from simple linear regression we work our way up to a working implementation of Kernel Regression from scratch using only numpy.