[
https://issues.apache.org/jira/browse/SPARK-20320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972249#comment-15972249
]
Jacek Laskowski commented on SPARK-20320:
-----------------------------------------
I'm playing with Spark SQL and multi-dimensional aggregates (like {{cube}}) and
don't think much about whether a given query is semantically correct or not. I
used {{count("id")}} to match what's in {{agg(grouping_id(count("value")))}} as
otherwise I would have gotten the error you face. Your query is incorrect and
to fix it is to add the grouping expression like {{count("id")}} (in your
particular case).
> AnalysisException: Columns of grouping_id (count(value#17L)) does not match
> grouping columns (count(value#17L))
> ---------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-20320
> URL: https://issues.apache.org/jira/browse/SPARK-20320
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Jacek Laskowski
> Priority: Minor
>
> I'm not questioning the {{AnalysisException}} (which I don't know whether
> should be reported or not), but the exception message that tells...nothing
> helpful.
> {code}
> val records = spark.range(5).flatMap(n => Seq.fill(n.toInt)(n))
> scala>
> records.cube(count("value")).agg(grouping_id(count("value"))).queryExecution.logical
> org.apache.spark.sql.AnalysisException: Columns of grouping_id
> (count(value#17L)) does not match grouping columns (count(value#17L));
> at
> org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveGroupingAnalytics$$anonfun$org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveGroupingAnalytics$$replaceGroupingFunc$1.applyOrElse(Analyzer.scala:313)
> at
> org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveGroupingAnalytics$$anonfun$org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveGroupingAnalytics$$replaceGroupingFunc$1.applyOrElse(Analyzer.scala:308)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
