Re: Is it required to remove checkpoint when submitting a code change?

2015-09-10 Thread Ricardo Luis Silva Paiva
eally appreciate any help on this. Many thanks, Ricardo On Thu, Sep 3, 2015 at 1:58 PM, Ricardo Luis Silva Paiva < ricardo.pa...@corp.globo.com> wrote: > Good tip. I will try that. > > Thank you. > > On Wed, Sep 2, 2015 at 6:54 PM, Cody Koeninger <c...@koeninger.org> wrote:

Re: Is it required to remove checkpoint when submitting a code change?

2015-09-03 Thread Ricardo Luis Silva Paiva
guration file so your jar doesn't change? I tend to stick even my > app-specific parameters in an external spark config so everything is in one > place. > > On Wed, Sep 2, 2015 at 4:48 PM, Ricardo Luis Silva Paiva < > ricardo.pa...@corp.globo.com> wrote: > >> Hi

Is it required to remove checkpoint when submitting a code change?

2015-09-02 Thread Ricardo Luis Silva Paiva
Hi, Is there a way to submit an app code change, keeping the checkpoint data or do I need to erase the checkpoint folder every time I re-submit the spark app with a new jar? I have an app that count pageviews streaming from Kafka, and deliver a file every hour from the past 24 hours. I'm using