Loading...

7.5 Gradient Boosting (L07: Ensemble Methods)

14711 260________

Sebastian's books: sebastianraschka.com/books/

In this video, we will take the concept of boosting a step further and talk about gradient boosting. Where AdaBoost uses weights for training examples to boost the trees in the next round, gradient boosting uses the gradients of the loss to compute residuals on which the next tree in the sequence is fit.

XGBoost paper mentioned in the video: dl.acm.org/doi/pdf/10.1145/2939672.2939785

Link to the code: github.com/rasbt/stat451-machine-learning-fs20/tre…

-------

This video is part of my Introduction of Machine Learning course.

Next video:    • 7.6 Random Forests (L07: Ensemble Methods)  

The complete playlist:    • Intro to Machine Learning and Statistical ...…

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/ml-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka

コメント