Re: spark hangs at broadcasting during a filter

2015-08-05 Thread Alex Gittens
point. I'm using a cluster of 30 r3.8xlarge EC2 >> instances (244Gb, 32 cores) with spark in standalone mode with 220G >> executor >> and driver memory, and using the kyroserializer. >> >> Any ideas on what could be causing this hang? >> >> >&g

Re: spark hangs at broadcasting during a filter

2015-08-05 Thread Philip Weaver
mode with 220G > executor > and driver memory, and using the kyroserializer. > > Any ideas on what could be causing this hang? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/spark-hangs-at-broadcasting-during-a-filter-tp24143.ht

spark hangs at broadcasting during a filter

2015-08-05 Thread AlexG
sing this hang? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-hangs-at-broadcasting-during-a-filter-tp24143.html Sent from the Apache Spark User List mailing list archive at Nabble.com. ---