Dears,
is there a way to bind a slave to the public IP (instead of the private IP)
16/02/12 14:54:03 INFO SparkDeploySchedulerBackend: Granted executor ID
app-20160212135403-0009/0 on hostPort 172.31.19.203:39841 with 2 cores,
1024.0 MB RAM
thanks,
C
anything.
Christopher Bourez
06 17 17 50 60
On Mon, Jan 25, 2016 at 10:14 PM, Christopher Bourez <
christopher.bou...@gmail.com> wrote:
> Here is a pic of memory
> If I put --conf spark.driver.memory=3g, it increases the displaid memory,
> but the problem remains... for a file t
It has no sense to work with files smaller than a few Mo...
Do not hesitate to ask me questions if you try to help and reproduce the
bug,
Best
Christopher Bourez
06 17 17 50 60
LUE >> test.csv
done
Christopher Bourez
06 17 17 50 60
On Mon, Jan 25, 2016 at 10:01 PM, Christopher Bourez <
christopher.bou...@gmail.com> wrote:
> Josh,
>
> Thanks a lot !
>
> You can download a video I created :
> https://s3-eu-west-1.amazonaws.com/christopherbourez/pub
/public/test.csv
And then the command lines I launch are :
bin\pyspark --master local[1]
sc.textFile("test.csv").take(1)
As you can see, sc.textFile("test.csv", 2000).take(1) works well
Thanks a lot !
Christopher Bourez
06 17 17 50 60
On Mon, Jan 25, 2016 at 8:02 PM
Here is a pic of memory
If I put --conf spark.driver.memory=3g, it increases the displaid memory,
but the problem remains... for a file that is only 13M.
Christopher Bourez
06 17 17 50 60
On Mon, Jan 25, 2016 at 10:06 PM, Christopher Bourez <
christopher.bou...@gmail.com> wrote:
>
ecent call last):
File "", line 1, in
TypeError: trainRegressor() got an unexpected keyword argument
'minInstancesPerNode'
Thanks for your help
Christopher Bourez
06 17 17 50 60
