Ridge Regression

Ridge Regression is a linear model that addresses some problems of Ordinary Least Squares by imposing a penalty (or regularization term) to the weights

Ridge regression uses a L2 regularization

Auto-optimization is generally faster than trying multiple values, but it does not support sparse features (like text hashing)