Re: SparkSQL: Freezing while running TPC-H query 5

2014-09-24 Thread Samay
Hey Dan, Thanks for your reply. I have a couple of questions. 1) Were you able to verify that this is because of GC? If yes, then could you let me know how. 2) If this is GC, then do you know of any tuning I can do to reduce this GC pause? Regards, Samay On Tue, Sep 23, 2014 at 11:15 PM, Dan

SparkSQL: Freezing while running TPC-H query 5

2014-09-23 Thread Samay
other queries where there are long pauses of 200-300s before the query starts making progress on the master. Some of the queries complete while the others do not. Any help would be appreciated. Regards, Samay spark-defaults.conf http://apache-spark-user-list.1001560.n3.nabble.com/file/n14902/spark

SparkSQL TPC-H query 3 joining multiple tables

2014-09-03 Thread Samay
, o_shippriority ORDER BY revenue desc, o_orderdate LIMIT 10; The same syntax works when I join 2 tables (TPC-H query 12 for instance). Any ideas as to what the issue is? Thanks in advance, Samay -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-TPC-H-query-3