[GitHub] spark issue #22424: [SPARK-25303][STREAMING] For checkpointed DStreams, remo...

2018-09-15 Thread nikunjb
Github user nikunjb commented on the issue: https://github.com/apache/spark/pull/22424 @dongjoon-hyun @tdas Can you please help review this PR? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #22423: [SPARK-25302][STREAMING] Checkpoint the reducedStream in...

2018-09-15 Thread nikunjb
Github user nikunjb commented on the issue: https://github.com/apache/spark/pull/22423 @dongjoon-hyun @tdas Can you please help review this PR? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #22424: [SPARK-25303][STREAMING] For checkpointed DStream...

2018-09-14 Thread nikunjb
GitHub user nikunjb opened a pull request: https://github.com/apache/spark/pull/22424 [SPARK-25303][STREAMING] For checkpointed DStreams, remove the parent… …RemeberDuration - this will be recalculated to a minimum value ## How was this patch tested

[GitHub] spark pull request #22423: [SPARK-25302][STREAMING] Checkpoint the reducedSt...

2018-09-14 Thread nikunjb
GitHub user nikunjb opened a pull request: https://github.com/apache/spark/pull/22423 [SPARK-25302][STREAMING] Checkpoint the reducedStream in ReducedWindo… …wDStream so as to cut the lineage completely to parent ## What changes were proposed in this pull request