[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323970#comment-14323970 ] Sean Owen commented on SPARK-5829: -- This is what I have in mind as an example; it does no

[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323619#comment-14323619 ] Littlestar commented on SPARK-5829: --- But it depends on "org.apache.spark.streaming.Time"

[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323529#comment-14323529 ] Littlestar commented on SPARK-5829: --- The following code as same as saveAsNewAPIHadoopFi

[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322408#comment-14322408 ] Littlestar commented on SPARK-5829: --- FileInputDStream.scala override def compute(valid