Re: Automatic driver restart does not seem to be working in Spark Standalone

2015-11-25 Thread Kay-Uwe Moosheimer
Testet with Spark 1.5.2 Š Works perfect when exit code is non-zero. And does not Restart with exit code equals zero. Von: Prem Sure Datum: Mittwoch, 25. November 2015 19:57 An: SRK Cc: Betreff: Re: Automatic driver

How to use data from Database and reload every hour

2015-11-05 Thread Kay-Uwe Moosheimer
I have the following problem. We have MySQL and an Spark cluster. We need to load 5 different validation-instructions (several thousand of entries each) and use this information on the executors to decide if content from Kafka-Streaming is for process a or b. The streaming data from kafka are json