回复:PartitionNotFoundException on deploying streaming job

2017-04-05 Thread Zhijiang(wangzhijiang999)
Yes, it should be an improvement to add some timeout/wait mechanism to avoid such exception as you mentioned.Currently the LAZY_FROM_SOURCES schedule mode can avoid this issue, but for streaming job it is not suggested to use this schedule mode.Maybe there are other ways to work around after you

回复:PartitionNotFoundException on deploying streaming job

2017-04-04 Thread Zhijiang(wangzhijiang999)
Hi Kamil,       When the producer receives the PartitionRequest from downstream task, first it will check whether the requested partition is already registered. If not, it will reponse PartitionNotFoundException.And the upstream task is submitted and begins to run, it will registered all its par