Re: Important features for each fold

> On Feb 13, 2023, at 9:28 PM, Michael Hall <[email protected]> wrote:
> 
> 
> 
>> On Feb 13, 2023, at 9:09 PM, Peter Reutemann <[email protected]> wrote:
>> 
>>> How can we get features selection for each fold of the cross validation. I think it was possible in the earlier version of weka explorer but I cannot see the option now.
>> 
>> I'm not aware of such an option ever being available. The Attribute
>> selection tab in the Weka Explorer only gives you the summary of how
>> often an attribute was selected during cross-validation (when using
>> subset evals) or the average rank/merit when performing ranking.
>> 
>> For your desired output, you would have to simulate cross-validation
>> yourself, generate train/test splits, perform attribute selection on
>> the train split and record the selected attribute indices.
>> That's something you can do with Jython, Groovy or python-weka-wrapper3.
>> ADAMS comes with a flow that performs repeated CV on a user-selected
>> dataset, populating a table with information on whether an attribute
>> was selected or not
>> (adams-weka-attribute_selection_simulated_cv.flow).
>> 
> 
> I thought I remembered something being available per fold with KnowledgeFlow but could be mistaken.

This maybe

https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=eb54dd6009a1dc6cb58840da8e49ecfc03df710f <https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=eb54dd6009a1dc6cb58840da8e49ecfc03df710f>

View models produced by classifiers for each fold in a cross validation

_______________________________________________
Wekalist mailing list -- [email protected]
Send posts to [email protected]
To unsubscribe send an email to [email protected]
To subscribe, unsubscribe, etc., visit https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html