Session 10 :: Information Based Learning

This session covers how concepts from information theory can be used to build prediction models. We discuss decision trees, entropy and information gain, and present the ID3 algorithm.

Reading for this Session

1. Chapter 4 of Fundamentals of Machine Learning for Predictive Data Analytics
2. Chapter 4 Slides 'A' (internal)
3. Chapter 4 Slides 'B' (internal)
4. An introduction to machine learning with scikit-learn
5. scikit-learn Decision Trees

Slides are posted on http://iCollege.gsu.edu