I timed the third line and here are stage timings, collect at SparkPlan.scala:52 ----- 0.5 s mapPartitions at Exchange.scala:58 ----- 0.7 s RangePartitioner at Exchange.Scala:62 ----- 0.7 s RangePartitioner at Exchange.Scala:62 ----- 0.5 s mapPartitions at Exchange.scala:44 ----- 13 s
Thanks, Santosh -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SQLContext-and-HiveContext-Query-Performance-tp6948p6981.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
