Re: [scikit-learn] custom scorer needs group information: how?

2021-06-03 Thread Emanuele Olivetti
> Hi Emanuele, > > In the meantime, you could also try the hack I have written here: > https://stackoverflow.com/questions/49581104/sklearn-gridsearchcv-not-using-sample-weight-in-score-function/49598597#49598597 > > Cheers, > Adrin > > On Sat, May 22, 2021 at 7:54 PM Eman

Re: [scikit-learn] custom scorer needs group information: how?

2021-05-22 Thread Emanuele Olivetti
Hi Alex, Thank you for the quick response. That SLEP looks very interesting! Indeed I had the impression that there was no easy way around the issue of automatically passing additional (meta)data to scorers. Irrespective of my issue, I hope the SLEP will get the green light soon. Best, Emanuele

[scikit-learn] custom scorer needs group information: how?

2021-05-22 Thread Emanuele Olivetti
Dear scikit-learn Community, I'd like to create a custom scorer to be used with GroupKFold and GridSearchCV. The issue is that I need to use the grouping information also "inside" the custom scorer, to compute the desired metric. How to do that? Here follows a simplified example to explain in det