Hi, Thanks Sean! You're right -- my local repo got hosed. I don't know why the patch with AnalysisBarrier didn't go through.
Speaking of the patch [1] I've noticed a sentence in the scaladoc of AnalysisBarrier that does not make much sense to me. There's something missing in it, isn't there? > The SQL Analyzer goes through a whole query plan even most part of it is analyzed. What is this sentence telling me? `if` missing in between "even most"? [1] https://github.com/apache/spark/blob/00d176d2fe7bbdf55cb3146a9cb04ca99b1858b7/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala?utf8=%E2%9C%93#L890 Pozdrawiam, Jacek Laskowski ---- https://about.me/JacekLaskowski Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Fri, Dec 8, 2017 at 6:40 PM, Sean Owen <so...@cloudera.com> wrote: > Build is fine for me, and on Jenkins. Try a clean build? > > On Fri, Dec 8, 2017 at 11:04 AM Jacek Laskowski <ja...@japila.pl> wrote: > >> Hi, >> >> Just got BUILD FAILURE and have been wondering if it's just me or is this >> a known issue that's being worked on? >> >> (Sorry if that's just my local setup that I got broken) >> >> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ >> spark-catalyst_2.11 --- >> [INFO] Using zinc server for incremental compilation >> [warn] Pruning sources from previous analysis, due to incompatible >> CompileSetup. >> [info] Compiling 222 Scala sources and 27 Java sources to >> /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes... >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728: not found: >> value AnalysisBarrier >> [error] AnalysisBarrier(newRight) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081: not found: >> value AnalysisBarrier >> [error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) => >> sa >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134: not found: >> value AnalysisBarrier >> [error] return AnalysisBarrier(plan) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409: not found: >> value AnalysisBarrier >> [error] case filter @ Filter(havingCondition, >> AnalysisBarrier(aggregate: Aggregate)) => >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410: not found: >> value AnalysisBarrier >> [error] apply(Filter(havingCondition, aggregate)).mapChildren( >> AnalysisBarrier) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470: not found: >> value AnalysisBarrier >> [error] case sort @ Sort(sortOrder, global, >> AnalysisBarrier(aggregate: Aggregate)) => >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471: not found: >> value AnalysisBarrier >> [error] apply(Sort(sortOrder, global, aggregate)).mapChildren( >> AnalysisBarrier) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345: not found: >> value AnalysisBarrier >> [error] case AnalysisBarrier(child) => child >> [error] ^ >> [error] 8 errors found >> [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s] >> [INFO] ------------------------------------------------------------ >> ------------ >> >> Pozdrawiam, >> Jacek Laskowski >> ---- >> https://about.me/JacekLaskowski >> Spark Structured Streaming https://bit.ly/spark-structured-streaming >> Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark >> Follow me at https://twitter.com/jaceklaskowski >> >
