Entropy And Information Gain

Entropy and Information Gain is used to calculate the information gain during splitting the tree into branches.

[!def] Entropy & Information Gain Formular
$$
\text{Entropy} = - \sum_i p_i ; log_2p_i
$$
$$
IG = 1 - Entropy
$$