Re: [discuss] ending support for Java 7 in Spark 2.0

Since my original email, I've talked to a lot more users and looked at what various environments support. It is true that a lot of enterprises, and even some technology companies, are still using Java 7. One thing is that up until this date, users still can't install openjdk 8 on Ubuntu by

Re: explain codegen

Works for me on latest master. scala> sql("explain codegen select 'a' as a group by 1").head res3: org.apache.spark.sql.Row = [Found 2 WholeStageCodegen subtrees. == Subtree 1 / 2 == WholeStageCodegen : +- TungstenAggregate(key=[], functions=[], output=[a#10]) : +- INPUT +- Exchange

Re: explain codegen

Hi, Looks related to the recent commit... Repository: spark Updated Branches: refs/heads/master 2262a9335 -> 1f0c5dceb [SPARK-14350][SQL] EXPLAIN output should be in a single cell Jacek 03.04.2016 7:00 PM "Ted Yu" napisał(a): > Hi, > Based on master branch refreshed

explain codegen

Hi, Based on master branch refreshed today, I issued 'git clean -fdx' first. Then this command: build/mvn clean -Phive -Phive-thriftserver -Pyarn -Phadoop-2.6 -Dhadoop.version=2.7.0 package -DskipTests I got the following error: scala> sql("explain codegen select 'a' as a group by 1").head

[SQL] Dataset.map gives error: missing parameter type for expanded function?

Hi, (since 2.0.0-SNAPSHOT it's more for dev not user) With today's master I'm getting the following: scala> ds res14: org.apache.spark.sql.Dataset[(String, Int)] = [_1: string, _2: int] // WHY?! scala> ds.groupBy(_._1) :26: error: missing parameter type for expanded function ((x$1) => x$1._1)

Re: how about a custom coalesce() policy?

Sure, here is the jira and this is the PR. Nezih On Sat, Apr 2, 2016 at 10:40 PM Hemant Bhanawat wrote: > correcting email id for Nezih > > Hemant Bhanawat