Comparing the classification results ?
3 views (last 30 days)
Show older comments
I want to compare the result of ANN with some other classifiers such as LDA, SVM , etc. and I am using 10-fold cross validation (9 for training and 1 for testing) for those classifiers. In ANN, the data is divided to three parts (0.6 training 0.2 validation 0.2 testing). How can I evaluate all the methods in the same way. For example 10-fold cross validation for all of them including ANN.
0 Comments
Answers (1)
Greg Heath
on 18 Jul 2017
If the other classifiers do not use a validation set, then you should not either. In fact you should use the exact same training and testing subsets.
So, change your default 0.7/0.15/0.5 ratio to 0.9/0.0/0.1 and use the exact same data divisions for all classifiers.
The MATLAB default is PATTERNNET (with TRAINSCG).
If NN results are bad, post again.
Hope this helps.
Thank you for formally accepting my answer
Greg
1 Comment
Greg Heath
on 18 Jul 2017
CORRECTION:
default trn/val/tst ratios are 0.7/0.15/0.15
Greg
See Also
Categories
Find more on Get Started with Statistics and Machine Learning Toolbox in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!