Github user srowen commented on the issue:
https://github.com/apache/spark/pull/17477
Hm, really weird @HyukjinKwon but this fails on the SBT master build but
only for Hadoop 2.6. Maven and 2.7 are fine.
```
[error]
/home/jenkins/workspace/spark-master-test-sbt-hadoop-2.6/core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala:123:
value createDatumWriter is not a member of org.apache.avro.generic.GenericData
[error] writerCache.getOrElseUpdate(schema,
GenericData.get.createDatumWriter(schema))
[error]
```
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-2.6/2770/consoleFull
I can only assume it's some classpath-related problem, such that the
classpath resolution for Hadoop 2.6 libs and for SBT, and only for the scaladoc
plugin, doesn't see the right version of Avro.
This might be tricky to resolve. Have you seen anything like this before? I
wonder if there is any clear difference between the classpath scaladoc would
use vs scalac?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
