Re: Hadoop credentials missing in some tasks?

2016-02-05 Thread Peter Vandenabeele
On Fri, Feb 5, 2016 at 12:58 PM, Gerard Maas wrote: > Hi, > > We're facing a situation where simple queries to parquet files stored in > Swift through a Hive Metastore sometimes fail with this exception: > > org.apache.spark.SparkException: Job aborted due to stage

Loading JSON Dataset fails with com.fasterxml.jackson.databind.JsonMappingException

2014-11-30 Thread Peter Vandenabeele
in 0.009 s 14/11/30 12:48:20 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 14/11/30 12:48:20 INFO spark.SparkContext: Job finished: count at console:19, took 0.012281729 s res9: Long = 13 -- Peter Vandenabeele http://www.allthingsdata.io

Re: Loading JSON Dataset fails with com.fasterxml.jackson.databind.JsonMappingException

2014-11-30 Thread Peter Vandenabeele
On Sun, Nov 30, 2014 at 1:10 PM, Peter Vandenabeele pe...@vandenabeele.com wrote: On spark 1.1.0 in Standalone mode, I am following https://spark.apache.org/docs/1.1.0/sql-programming-guide.html#json-datasets to try to load a simple test JSON file (on my local filesystem, not in hdfs