Hope it will be delivered soon.
>
> Best Regards,
> Shixiong Zhu
>
> 2015-09-24 13:45 GMT+08:00 Bin Wang <wbi...@gmail.com>:
>
>> I've read the source code and it seems to be impossible, but I'd like to
>> confirm it.
>>
>> It is a very useful feature.
t; doesn't have a doc now...
>
>
> Best Regards,
> Shixiong Zhu
>
> 2015-09-24 17:26 GMT+08:00 Bin Wang <wbi...@gmail.com>:
>
>> Data that are not updated should be saved earlier: while the data added
>> to the DStream at the first time, it should be considered a
.disconnect())
> }
>
>
> Best Regards,
> Shixiong Zhu
>
> 2015-09-24 17:42 GMT+08:00 Bin Wang <wbi...@gmail.com>:
>
>> It seems like a work around. But I don't know how to get the database
>> connection from the working nodes.
>>
>> Shixiong Zh
I find the checkpoint directory structure is like this:
-rw-r--r-- 1 root root 134820 2015-09-23 16:55
/user/root/checkpoint/checkpoint-144299850
-rw-r--r-- 1 root root 134768 2015-09-23 17:00
/user/root/checkpoint/checkpoint-144299880
-rw-r--r-- 1 root root 134895
上午9:45写道：
> Could you provide the logs on when and how you are seeing this error?
>
> On Wed, Sep 23, 2015 at 6:32 PM, Bin Wang <wbi...@gmail.com> wrote:
>
>> BTW, I just kill the application and restart it. Then the application
>> cannot recover from checkpoint becaus
BTW, I just kill the application and restart it. Then the application
cannot recover from checkpoint because of some lost of RDD. So I'm wonder,
if there are some failure in the application, won't it possible not be able
to recovery from checkpoint?
Bin Wang <wbi...@gmail.com>于2015年9月23日周三
I've read the source code and it seems to be impossible, but I'd like to
confirm it.
It is a very useful feature. For example, I need to store the state of
DStream into my database, in order to recovery them from next redeploy. But
I only need to save the updated ones. Save all keys into database
stall…..’
>
>
> Azuryy Yu
>
>
>
> On Sep 22, 2015, at 13:36, Bin Wang <wbi...@gmail.com> wrote:
>
> However I find some scripts in dev/audit-release, can I use them?
>
> Bin Wang <wbi...@gmail.com>于2015年9月22日周二 下午1:34写道：
>
>> No, I mean push
ad of branch-1.5 is 1.5.1-SNAPSHOT -- soon to be 1.5.1 release
> candidates and then the 1.5.1 release.
>
> On Mon, Sep 21, 2015 at 9:51 PM, Bin Wang <wbi...@gmail.com> wrote:
>
>> I'd like to use some important bug fixes in 1.5 branch and I look for the
>> apache maven
I'd like to use some important bug fixes in 1.5 branch and I look for the
apache maven host, but don't find any snapshot for 1.5 branch.
https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-core_2.10/1.5.0-SNAPSHOT/
I can find 1.4.X and 1.6.0 versions, why there is no
ll git commit history of exactly what is in that build readily available,
> not just somewhat arbitrary JARs.
>
> On Mon, Sep 21, 2015 at 9:57 PM, Bin Wang <wbi...@gmail.com> wrote:
>
>> But I cannot find 1.5.1-SNAPSHOT either at
>> https://repository.apache.org/conten
However I find some scripts in dev/audit-release, can I use them?
Bin Wang <wbi...@gmail.com>于2015年9月22日周二 下午1:34写道：
> No, I mean push spark to my private repository. Spark don't have a
> build.sbt as far as I see.
>
> Fengdong Yu <fengdo...@everstring.com>于2015年9月22日
leases" at nexus + "content/repositories/releases")
>
> }
>
>
>
> On Sep 22, 2015, at 13:26, Bin Wang <wbi...@gmail.com> wrote:
>
> My project is using sbt (or maven), which need to download dependency from
> a maven repo. I have m
Never mind. I've found a PR and it merged:
https://github.com/apache/spark/pull/8624/commits
Bin Wang <wbi...@gmail.com>于2015年9月17日周四 下午4:50写道：
> I'm using spark streaming and use updateStateByKey, which forced to use
> checkpoint. In my unit test, I create a queueStream to test.
in the memory. Something
like a pipeline should be OK.
Is it difficult to implement on top of the current implementation?
Thanks.
---
Bin Wang
15 matches
Mail list logo
