multiple pyspark instances simultaneously (same time)

2015-10-20 Thread jeff.sadow...@gmail.com
I am having issues trying to setup spark to run jobs simultaneously. I thought I wanted FAIR scheduling? I used the templated fairscheduler.xml as is when I start pyspark I see the 3 expected pools: production, test, and default when I login as second user and run pyspark I see the

Can not subscript to mailing list

2015-10-20 Thread jeff.sadow...@gmail.com
I am having issues subscribing to the user@spark.apache.org mailing list. I would like to be added to the mailing list so I can post some configuration questions I have to the list that I do not see asked on the list. When I tried adding myself I got an email titled "confirm subscribe to

multiple pyspark instances simultaneously (same time)

2015-10-15 Thread jeff.sadow...@gmail.com
I am having issues trying to setup spark to run jobs simultaneously. I thought I wanted FAIR scheduling? I used the templated fairscheduler.xml as is when I start pyspark I see the 3 expected pools: production, test, and default when I login as second user and run pyspark I see the expected