Author: Mohssen Mohammed, Muhammad Badruddin Khan;Eihab Bashier Mohammed Bashier
-
loc 934 - ID3 is information gain, whereas in C4.5, the criterion is gain ratio.
-
loc 940 - Shannon entropy quantifies this uncertainty in terms of expected value of the information present in the message. H(X)=∑iP(xi)I(xi)=−∑iP(xi)log
-
loc 940 - Shannon entropy quantifies this uncertainty in terms of expected value of the information present in the message. H(X)=∑iP(xi)I(xi)=−∑iP(xi)logbP(xi)
-
loc 1152 - bias problem of the measure of information gain, another measure called gain ratio was proposed.