Cross validation in Weka_Split the data set or not?

"DERYA YILMAZ" <[email protected]>
Newsgroups gmane.comp.ai.weka
Message-ID <[email protected]>
Good afternoon,
I have a confusion about the CV application in Weka. I will appreciate it
if you explain which method is right?

1) Should I first split my data as training and test set in Weka (I used
the stratified folds option to do that to create 80-20% sets) then apply 5
fold CV on my training set to tune parameters and then evaluate the
Classifier's performance using the test data by choosing 5 fold CV option?

2) Should I directly use the entire data set in Weka, choose the CV
option, tune parameters and use the entire data set again while presenting
the evaluation results?

3) Should I manually create different folds (e.g. 5 folds), get each
result one by one, and calculate the average?

Thanks a lot,



_______________________________________________
Wekalist mailing list -- [email protected]
Send posts to [email protected]
To unsubscribe send an email to [email protected]
To subscribe, unsubscribe, etc., visit https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.