[
https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Douglas Colkitt updated SPARK-30028:
------------------------------------
Description:
Building from latest source with the following command:
{code:java}
./build/mvn -DskipTests clean package {code}
Then manually interrupt the build at the Spark Core stage. Then resume build
with
{code:java}
./build/mvn -DskipTests clean package -rf :spark-core_2.12{code}
Fails at Spark Project Catalyst stage with the following errors:
{code:java}
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @
spark-catalyst_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file:
/home/vagrant/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 300 Scala sources and 91 Java sources to
/home/vagrant/spark/sql/catalyst/target/scala-2.12/classes ...
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala:105:
Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/PostgreCastToBoolean.scala:45:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:137:
Java enum ALLOW_NUMERIC_LEADING_ZEROS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:138:
Java enum ALLOW_NON_NUMERIC_NUMBERS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:139:
Java enum ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER in Java enum Feature is
deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:141:
Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:208:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:375:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala:468:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[WARNING] 5 warnings found
{code}
This does not occur with an uninterrupted build.
I believe it's related to the changes introduced by commit __
_de21f28f8a0a41dd7eb8ed1ff8b35a6d7538958b_ on November 25, as the build doesn't
break with an earlier revision.
was:
Building from latest source with the following command:
{code:java}
./build/mvn -DskipTests clean package {code}
Fails at Spark Project Catalyst stage with the following errors:
{code:java}
[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @
spark-catalyst_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file:
/home/vagrant/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 300 Scala sources and 91 Java sources to
/home/vagrant/spark/sql/catalyst/target/scala-2.12/classes ...
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala:105:
Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/PostgreCastToBoolean.scala:45:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:137:
Java enum ALLOW_NUMERIC_LEADING_ZEROS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:138:
Java enum ALLOW_NON_NUMERIC_NUMBERS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:139:
Java enum ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER in Java enum Feature is
deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:141:
Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see
corresponding Javadoc for more information.
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:208:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:375:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[ERROR] [Error]
/home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala:468:
value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[WARNING] 5 warnings found
{code}
I believe it's related to the changes introduced by commit __
_de21f28f8a0a41dd7eb8ed1ff8b35a6d7538958b_ on November 25, as the build doesn't
break with an earlier revision.
Summary: Spark Catalyst build fails with Maven -rf :spark-core_2.12
(was: Spark Catalyst build fails - trimAll() not a member of UTF8String)
> Spark Catalyst build fails with Maven -rf :spark-core_2.12
> ----------------------------------------------------------
>
> Key: SPARK-30028
> URL: https://issues.apache.org/jira/browse/SPARK-30028
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 2.4.4
> Environment: Building with OpenJDK-11, Scala 2.12.8 and Maven 3.6.2.
> Using Debian 10 with kernel 4.19.0-6-amd64.
> Running inside a VirtualBox hosted on a MacBook Pro.
> Reporter: Douglas Colkitt
> Priority: Major
>
> Building from latest source with the following command:
> {code:java}
> ./build/mvn -DskipTests clean package {code}
> Then manually interrupt the build at the Spark Core stage. Then resume build
> with
> {code:java}
> ./build/mvn -DskipTests clean package -rf :spark-core_2.12{code}
> Fails at Spark Project Catalyst stage with the following errors:
> {code:java}
> [INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @
> spark-catalyst_2.12 ---
> [INFO] Using incremental compilation using Mixed compile order
> [INFO] Compiler bridge file:
> /home/vagrant/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
> [INFO] Compiling 300 Scala sources and 91 Java sources to
> /home/vagrant/spark/sql/catalyst/target/scala-2.12/classes ...
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala:105:
> Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated:
> see corresponding Javadoc for more information.
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/PostgreCastToBoolean.scala:45:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:137:
> Java enum ALLOW_NUMERIC_LEADING_ZEROS in Java enum Feature is deprecated:
> see corresponding Javadoc for more information.
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:138:
> Java enum ALLOW_NON_NUMERIC_NUMBERS in Java enum Feature is deprecated: see
> corresponding Javadoc for more information.
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:139:
> Java enum ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER in Java enum Feature is
> deprecated: see corresponding Javadoc for more information.
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:141:
> Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated:
> see corresponding Javadoc for more information.
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:208:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:375:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala:468:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [WARNING] 5 warnings found
>
> {code}
> This does not occur with an uninterrupted build.
> I believe it's related to the changes introduced by commit __
> _de21f28f8a0a41dd7eb8ed1ff8b35a6d7538958b_ on November 25, as the build
> doesn't break with an earlier revision.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
