[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717089#comment-16717089 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717090#comment-16717090 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717096#comment-16717096 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717093#comment-16717093 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717092#comment-16717092 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717095#comment-16717095 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717091#comment-16717091 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-12-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717094#comment-16717094 ] ASF GitHub Bot commented on SPARK-20568: gaborgsomogyi commented on a change in

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-11-05 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675833#comment-16675833 ] Jungtaek Lim commented on SPARK-20568: -- FYI, trait 'Source' has 'commit' method whi

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675823#comment-16675823 ] Apache Spark commented on SPARK-20568: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-11-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675822#comment-16675822 ] Apache Spark commented on SPARK-20568: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-11-02 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672805#comment-16672805 ] Jungtaek Lim commented on SPARK-20568: -- [~zsxwing] I've thought about it a bit. I'm

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-10-31 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16670904#comment-16670904 ] Jungtaek Lim commented on SPARK-20568: -- [~zsxwing] Yes I'll see the time slot and t

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-10-31 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16670897#comment-16670897 ] Shixiong Zhu commented on SPARK-20568: -- [~kabhwan] I think this is pretty useful. D

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-08-15 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16581979#comment-16581979 ] Jungtaek Lim commented on SPARK-20568: -- For me, the feature looks like the missing

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2018-02-08 Thread Julian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16356929#comment-16356929 ] Julian commented on SPARK-20568: I've started with Data ingestion using Structured Stream

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2017-06-19 Thread Fei Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053871#comment-16053871 ] Fei Shao commented on SPARK-20568: -- I also do not support this feature too. If we delet

[jira] [Commented] (SPARK-20568) Delete files after processing in structured streaming

2017-05-03 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995507#comment-15995507 ] Shixiong Zhu commented on SPARK-20568: -- [~srowen] Structured Streaming's Source has

[jira] [Commented] (SPARK-20568) Delete files after processing

2017-05-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994502#comment-15994502 ] Sean Owen commented on SPARK-20568: --- This conflicts with the general Spark model that o