On Fri, Feb 5, 2016 at 12:58 PM, Gerard Maas wrote:
> Hi,
>
> We're facing a situation where simple queries to parquet files stored in
> Swift through a Hive Metastore sometimes fail with this exception:
>
> org.apache.spark.SparkException: Job aborted due to stage
in 0.009 s
14/11/30 12:48:20 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 6.0,
whose tasks have all completed, from pool
14/11/30 12:48:20 INFO spark.SparkContext: Job finished: count at
console:19, took 0.012281729 s
res9: Long = 13
--
Peter Vandenabeele
http://www.allthingsdata.io
On Sun, Nov 30, 2014 at 1:10 PM, Peter Vandenabeele pe...@vandenabeele.com
wrote:
On spark 1.1.0 in Standalone mode, I am following
https://spark.apache.org/docs/1.1.0/sql-programming-guide.html#json-datasets
to try to load a simple test JSON file (on my local filesystem, not in
hdfs