XGBoost is an advanced gradient tree boosting algorithm. It has support for parallel processing, regularization and early stopping, which makes it a fast, scalable and accurate algorithm.
For more information on gradient tree boosting, see the "Gradient tree boosting" algorithm.