Re: Java SPI jar reload in Spark

2017-06-07 Thread Jonnas Li(Contractor)
mp;utm_source=email_sig&utm_medium=email_sig&utm_campaign=external_links> Alonso Isidoro Roman about.me/alonso.isidoro.roman 2017-06-06 12:14 GMT+02:00 Jonnas Li(Contractor) mailto:zhongshuang...@envisioncn.com>>: Thank for your quick response. These jars are used to defin

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
n google. https://github.com/spark-jobserver/spark-jobserver/issues/130 <https://about.me/alonso.isidoro.roman?promo=email_sig&utm_source=email_sig&utm_medium=email_sig&utm_campaign=external_links> Alonso Isidoro Roman about.me/alonso.isidoro.roman 2017-06-06 12:14 GMT+02:00 Jon

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
us from a functional point of view- functionality in jar changed and all your computation is wrong. On 6. Jun 2017, at 11:35, Jonnas Li(Contractor) mailto:zhongshuang...@envisioncn.com>> wrote: I have a Spark Streaming application, which dynamically calling a jar (Java SPI), and the jar is cal

Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
I have a Spark Streaming application, which dynamically calling a jar (Java SPI), and the jar is called in a mapWithState() function, it was working fine for a long time. Recently, I got a requirement which required to reload the jar during runtime. But when the reloading is completed, the spark