07-22-2010, 01:56 AM
imtiazyar Wrote:Q3)Dear
Avoiding over-fitting the data
In principle decision tree algorithm described in Figure 2 can grow each branch of the tree just deeply enough to perfectly classify the training examples. While this is sometimes a reasonable strategy, in fact it can lead to difficulties when there is noise in the data, or when the number of training examples is too small or too large to produce a representative sample of the true target function. In either of these cases, this simple algorithm can produce trees that over-fit the training examples.
I think you should mention the reference. Here is the reference link which will help students to explorer more and see the figuer 2 in this example.
Code:
http://dms.irb.hr/tutorial/tut_dtrees.php