Re: [scikit-learn] How to tune parameters when using partial_fit

2019-06-11 Thread Brown J.B. via scikit-learn
> > I'm curious about is there any suitable/general way to tune parameters > batch by batch? > Because the distribution is not easy to know when the dataset is too large > to load into memory. > Repeated subsampling to estimate a distribution is one alternative. Not guaranteed to match the global

Re: [scikit-learn] How to tune parameters when using partial_fit

2019-06-11 Thread lampahome
I know there's no built-in way to tune parameter batch by batch. I'm curious about is there any suitable/general way to tune parameters batch by batch? Because the distribution is not easy to know when the dataset is too large to load into memory. ___ sc

Re: [scikit-learn] How to tune parameters when using partial_fit

2019-06-10 Thread Andreas Mueller
There's no built-in way to do that with scikit-learn right now, sorry. On 6/10/19 6:58 AM, lampahome wrote: as title, I try to cluster a huge data, but I don't know how to tune parameters when clustering. If it's a small dataset, I can use gridsearchcv, but how to if it's a huge data? thx

[scikit-learn] How to tune parameters when using partial_fit

2019-06-10 Thread lampahome
as title, I try to cluster a huge data, but I don't know how to tune parameters when clustering. If it's a small dataset, I can use gridsearchcv, but how to if it's a huge data? thx ___ scikit-learn mailing list scikit-learn@python.org https://mail.pyt