Re: Hadoop credentials missing in some tasks?

2016-02-05 Thread Peter Vandenabeele
On Fri, Feb 5, 2016 at 12:58 PM, Gerard Maas wrote: > Hi, > > We're facing a situation where simple queries to parquet files stored in > Swift through a Hive Metastore sometimes fail with this exception: > > org.apache.spark.SparkException: Job aborted due to stage

Hadoop credentials missing in some tasks?

2016-02-05 Thread Gerard Maas
Hi, We're facing a situation where simple queries to parquet files stored in Swift through a Hive Metastore sometimes fail with this exception: org.apache.spark.SparkException: Job aborted due to stage failure: Task 6 in stage 58.0 failed 4 times, most recent failure: Lost task 6.3 in stage 58.0