Is the sampling of features with replacement too?
Many thanks! :)
Dear Alex,
So, by the sampling of features with replacement, I assume you mean that for every subsequent tree in the forest we use one or more features used in the trees made before it. If so, then yes it is the case. This has to be done because if we're making 1000 trees in a forest and we have only 20 features in our data we'll run out of features pretty soon.