On 05/13/2013 05:49 PM, Matthias Ekman wrote:
>> Unfortunately, this doesn't solve my problem. I'm still getting the same
>> error for an array with the dimension 2000x15. I'm very surprised as
>> this is not exactly a very large dataset. Are you sure there are no other
>> settings (maybe on
>> Unfortunately, this doesn't solve my problem. I'm still getting the same
>> error for an array with the dimension 2000x15. I'm very surprised as
>> this is not exactly a very large dataset. Are you sure there are no other
>> settings (maybe on a system level) that might interfere with this i
In fact, the limit is a signed 32-bit int, so 2147483647 and you have
24
bytes.
On Mon, May 13, 2013 at 8:01 AM, John Benediktsson wrote:
> Unfortunately, this doesn't solve my problem. I'm still getting the same
>> error for an array with the dimension 2000x15. I'm very surprised
>
> Unfortunately, this doesn't solve my problem. I'm still getting the same
> error for an array with the dimension 2000x15. I'm very surprised as
> this is not exactly a very large dataset. Are you sure there are no other
> settings (maybe on a system level) that might interfere with this iss
On 05/13/2013 04:48 PM, Matthias Ekman wrote:
Hi Andy,
thanks for your comment. I didn't know about the pre_dispatch
parameter before. Here is my PR that adds the parameter to
``cross_val_score``
https://github.com/scikit-learn/scikit-learn/pull/1961
Unfortunately, this doesn't solve my prob
Hi Andy,
thanks for your comment. I didn't know about the pre_dispatch parameter
before. Here is my PR that adds the parameter to ``cross_val_score``
https://github.com/scikit-learn/scikit-learn/pull/1961
Unfortunately, this doesn't solve my problem. I'm still getting the same
error for an array
Hi Matthias.
Unfortunately joblib doesn't handle large datasets very gracefully at
the moment.
Have you tried setting the pre_dispatch parameter? Otherwise it could be
that all jobs
are dispatched even if only two are run.
Hth,
Andy
On 05/12/2013 05:12 PM, Matthias Ekman wrote:
Dear all,
us
Dear all,
using sklearn 0.13 (fresh Ubuntu 12.04 installation), I'm getting the error
below, which I belief is a memory error. What strikes me is that I'm using
a machine with 512GB of RAM, so that shouldn't be happening.
Is there maybe a system setting that limits the amount of RAM on a user
bas
