Re: [scikit-learn] ensemble method within splearn

2016-12-09 Thread Nelle Varoquaux
Hello, This mailing list is dedicated to scikit-learn. For sparkit-learn information, I suggest you contact directly the developers directly, maybe by opening a ticket on their github project page: https://github.com/lensacom/sparkit-learn Thanks, Nelle On 9 December 2016 at 10:00, Debabrata Gho

[scikit-learn] ensemble method within splearn

2016-12-09 Thread Debabrata Ghosh
Hi, I have downloaded sparkit-learn from https://pypi.python.org/pypi/sparkit-learn but it doesn't have the ensemble method. Please can you suggest the solution for the same. It's urgent please. Thanks, Debu ___ scikit-learn m

[scikit-learn] Clustering information from one file

2016-12-09 Thread Fabio Santos via scikit-learn
Hi all, My name is Fábio and I'm new in scikit, and I trying to cluster information  from one file with python script (i fount on web). But i saw that the output had problem with numbers...See: Script# import clickimport reimport numpyimport random from collections import defaultdict from sklearn.

Re: [scikit-learn] Need Urgent help please in resolving JobLibMemoryError

2016-12-09 Thread Debabrata Ghosh
Thanks Piotr for your feedback ! I did look into the sparkit-learn yesterday but couldn't locate the fact that it contained RandomForestClassifier method in it. I would need to request customer for downloading this for me as I don't have permission for that. May I please get your possible help whe

Re: [scikit-learn] Need Urgent help please in resolving JobLibMemoryError

2016-12-09 Thread Piotr Bialecki
Hi Debu, I have not worked with pyspark yet and cannot resolve your error, but have you tried out sparkit-learn? https://github.com/lensacom/sparkit-learn It seems to be a package combining pyspark with sklearn and it also has a RandomForest and other classifiers: (SparkRandomForestClassifier,

Re: [scikit-learn] Need Urgent help please in resolving JobLibMemoryError

2016-12-09 Thread Debabrata Ghosh
Hi Piotr, Yes, I did use n_jobs = - 1 as well. But the code didn't run successfully. On my output screen , I got the following message instead of the JobLibMemoryError: 16/12/08 22:12:26 INFO YarnExtensionServices: In shutdown hook for org.apache.spark.scheduler.cluster.YarnEx

Re: [scikit-learn] Need Urgent help please in resolving JobLibMemoryError

2016-12-09 Thread Piotr Bialecki
Hi Debu, it seems that you run out of memory. Try using fewer processes. I don't think that n_jobs = 1000 will perform as you wish. Setting n_jobs to -1 uses the number of cores in your system. Greets, Piotr On 09.12.2016 08:16, Debabrata Ghosh wrote: Hi All, Greetings !