[R] randomForest question

Arne.Muller at sanofi-aventis.com Arne.Muller at sanofi-aventis.com
Wed Jul 26 13:32:52 CEST 2006


Hello,

I've a question regarding randomForest (from the package with same name). I've 16 featurs (nominative), 159 positive and 318 negative cases that I'd like to classify (binary classification).

Using the tuning from the e1071 package it turns out that the best performance if reached when using all 16 features per tree (mtry=16). However, the documentation of randomForest suggests to take the sqrt(#features), i.e. 4. How can I explain this difference? When using all features this is the same as a classical decision tree, with the difference that the tree is built and tested with different data sets, right?

example (I've tried different configurations, incl. changing ntree):
> param <- try(tune(randomForest, class ~ ., data=d.all318, range=list(mtry=c(4, 8, 16), ntree=c(1000))));
>
> summary(param)

Parameter tuning of `randomForest':

- sampling method: 10-fold cross validation 

- best parameters:
 mtry ntree
   16  1000

- best performance: 0.1571809 

- Detailed performance results:
  mtry ntree     error
1    4  1000 0.1928635
2    8  1000 0.1634752
3   16  1000 0.1571809

	thanks a lot for your help,

	kind regards,



More information about the R-help mailing list