Repository: spark Updated Branches: refs/heads/master a888fed30 -> ad935f526
[SPARK-20343][BUILD] Add avro dependency in core POM to resolve build failure in SBT Hadoop 2.6 master on Jenkins ## What changes were proposed in this pull request? This PR proposes to add ``` <dependency> <groupId>org.apache.avro</groupId> <artifactId>avro</artifactId> </dependency> ``` in core POM to see if it resolves the build failure as below: ``` [error] /home/jenkins/workspace/spark-master-test-sbt-hadoop-2.6/core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala:123: value createDatumWriter is not a member of org.apache.avro.generic.GenericData [error] writerCache.getOrElseUpdate(schema, GenericData.get.createDatumWriter(schema)) [error] ``` https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.6/2770/consoleFull ## How was this patch tested? I tried many ways but I was unable to reproduce this in my local. Sean also tried the way I did but he was also unable to reproduce this. Please refer the comments in https://github.com/apache/spark/pull/17477#issuecomment-294094092 Author: hyukjinkwon <gurwls...@gmail.com> Closes #17642 from HyukjinKwon/SPARK-20343. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ad935f52 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ad935f52 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ad935f52 Branch: refs/heads/master Commit: ad935f526f57a9621c0a5ba082b85414c28282f4 Parents: a888fed Author: hyukjinkwon <gurwls...@gmail.com> Authored: Sun Apr 16 14:36:42 2017 +0100 Committer: Sean Owen <so...@cloudera.com> Committed: Sun Apr 16 14:36:42 2017 +0100 ---------------------------------------------------------------------- core/pom.xml | 4 ++++ 1 file changed, 4 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/ad935f52/core/pom.xml ---------------------------------------------------------------------- diff --git a/core/pom.xml b/core/pom.xml index 97a463a..24ce36d 100644 --- a/core/pom.xml +++ b/core/pom.xml @@ -35,6 +35,10 @@ <dependencies> <dependency> <groupId>org.apache.avro</groupId> + <artifactId>avro</artifactId> + </dependency> + <dependency> + <groupId>org.apache.avro</groupId> <artifactId>avro-mapred</artifactId> <classifier>${avro.mapred.classifier}</classifier> </dependency> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org