Re: NPE in using AvroKeyValueInputFormat for newAPIHadoopFile

check version compatibility I think avro lib should be 1.7.4 check that no other lib brings transitive dependency of other avro version On 16 December 2015 at 09:44, Jinyuan Zhou wrote: > Hi, I tried to load avro files in hdfs but keep getting NPE. > I am using

Re: NPE in using AvroKeyValueInputFormat for newAPIHadoopFile

>From Spark's root pom.xml : 1.7.7 FYI On Wed, Dec 16, 2015 at 3:06 PM, Igor Berman wrote: > check version compatibility > I think avro lib should be 1.7.4 > check that no other lib brings transitive dependency of other avro version > > > On 16 December 2015 at

NPE in using AvroKeyValueInputFormat for newAPIHadoopFile

Hi, I tried to load avro files in hdfs but keep getting NPE. I am using AvroKeyValueInputFormat inside newAPIHadoopFile method. Anyone have any clue? Here is stack trace Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 4 in stage 0.0 failed 4