Re: [scikit-learn] custom scorer needs group information: how?

2021-05-22 Thread Emanuele Olivetti
Hi Alex, Thank you for the quick response. That SLEP looks very interesting! Indeed I had the impression that there was no easy way around the issue of automatically passing additional (meta)data to scorers. Irrespective of my issue, I hope the SLEP will get the green light soon. Best, Emanuele

Re: [scikit-learn] custom scorer needs group information: how?

2021-05-22 Thread Alexandre Gramfort
hi Emanuelle, I would suggest you have a look at https://github.com/scikit-learn/enhancement_proposals/pull/55 it's work in progress though Alex ___ scikit-learn mailing list scikit-learn@python.org https://mail.python.org/mailman/listinfo/scikit-learn

[scikit-learn] custom scorer needs group information: how?

2021-05-22 Thread Emanuele Olivetti
Dear scikit-learn Community, I'd like to create a custom scorer to be used with GroupKFold and GridSearchCV. The issue is that I need to use the grouping information also "inside" the custom scorer, to compute the desired metric. How to do that? Here follows a simplified example to explain in det