Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed..

) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Please suggest your answer Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Is there a way to insert data into existing parquet file using spark ?

it to impala. I want to insert data into existing parquet file instead of creating new parquet file. I have tried with INSERT statement but it makes performance too slow. Please suggest is there any way to insert or append data into existing parquet file. Regards, Rafeeq S *(“What you do is what

How to make Spark Streaming write its output so that Impala can read it?

directory or otherwise in a form that is instantly readable by Impala? Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Spark RuntimeException due to Unsupported datatype NullType

$ParquetOperations$.apply(SparkStrategies.scala:156) Please provide your valuable solution for above issue. Thanks in Advance!. Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Spark stream data from kafka topics and output as parquet file on HDFS

, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Re: Spark stream data from kafka topics and output as parquet file on HDFS

*as parquet file on HDFS ?* *Please give your suggestion.* Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )* On Tue, Aug 5, 2014 at 11:55 AM, Dibyendu Bhattacharya dibyendu.bhattach...@gmail.com wrote: You can try this Kafka Spark Consumer which I