Re: Java SPI jar reload in Spark

2017-06-07 Thread Ryan
..@gmail.com> > > 抄送: Jörn Franke <jornfra...@gmail.com>, "user@spark.apache.org" < > user@spark.apache.org> > 主题: Re: Java SPI jar reload in Spark > > I used java.util.ServiceLoader > <https://docs.oracle.com/javase/7/docs/api/java/util/ServiceLoader.html>

Re: Java SPI jar reload in Spark

2017-06-07 Thread Jonnas Li(Contractor)
alons...@gmail.com>> 抄送: Jörn Franke <jornfra...@gmail.com<mailto:jornfra...@gmail.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> 主题: Re: Java SPI jar reload in Spark I used java.u

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
s Li 发件人: Jörn Franke <jornfra...@gmail.com<mailto:jornfra...@gmail.com>> 日期: 2017年6月6日 星期二 下午5:55 至: Zhongshuang Li <zhongshuang...@envisioncn.com<mailto:zhongshuang...@envisioncn.com>> 抄送: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spar

Re: Java SPI jar reload in Spark

2017-06-06 Thread Alonso Isidoro Roman
日期: 2017年6月6日 星期二 下午5:55 > 至: Zhongshuang Li <zhongshuang...@envisioncn.com> > 抄送: "user@spark.apache.org" <user@spark.apache.org> > 主题: Re: Java SPI jar reload in Spark > > Why do you need jar reloading? What functionality is executed during jar > reloading. Maybe

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
nvisioncn.com>> 抄送: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> 主题: Re: Java SPI jar reload in Spark Why do you need jar reloading? What functionality is executed during jar reloading. Maybe

Re: Java SPI jar reload in Spark

2017-06-06 Thread Jörn Franke
Why do you need jar reloading? What functionality is executed during jar reloading. Maybe there is another way to achieve the same without jar reloading. In fact, it might be dangerous from a functional point of view- functionality in jar changed and all your computation is wrong. > On 6. Jun

Java SPI jar reload in Spark

2017-06-06 Thread Jonnas Li(Contractor)
I have a Spark Streaming application, which dynamically calling a jar (Java SPI), and the jar is called in a mapWithState() function, it was working fine for a long time. Recently, I got a requirement which required to reload the jar during runtime. But when the reloading is completed, the spark