Re: How to enable Tungsten in Spark 1.5 for Spark SQL?

2015-09-10 Thread Umesh Kacha
Nice Ted thanks much highest performance without any configuration changes amazed! Looking forward to running Spark 1.5 on my 2 tb skewed data which involves group by union etc any other tips if you know for spark 1.5 On Sep 10, 2015 8:12 PM, "Ted Yu" wrote: > Please see

Re: How to enable Tungsten in Spark 1.5 for Spark SQL?

2015-09-10 Thread Ted Yu
Please see the following in sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala : val TUNGSTEN_ENABLED = booleanConf("spark.sql.tungsten.enabled", defaultValue = Some(true), doc = "When true, use the optimized Tungsten physical execution backend which explicitly " +

How to enable Tungsten in Spark 1.5 for Spark SQL?

2015-09-10 Thread unk1102
Hi Spark 1.5 looks promising how do we enable project tungsten for spark sql or is it enabled by default please guide. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-enable-Tungsten-in-Spark-1-5-for-Spark-SQL-tp24642.html Sent from the Apache Spark