[GitHub] spark pull request: Add recursive directory file search to fileInp...

2014-04-27 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/537#discussion_r12029172 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala --- @@ -327,18 +327,18 @@ class StreamingContext private[streaming] (

[GitHub] spark pull request: Add recursive directory file search to fileInp...

2014-04-24 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/537#issuecomment-41334446 Also, please add a unit test for this usecase in the InputStreamsSuite --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: Add recursive directory file search to fileInp...

2014-04-24 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/537#issuecomment-41334352 Can you please add a JIRA for this and add the JIRA number in the title, like other PRs. --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark pull request: Add recursive directory file search to fileInp...

2014-04-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/537#issuecomment-41315719 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: Add recursive directory file search to fileInp...

2014-04-24 Thread patrickotoole
GitHub user patrickotoole opened a pull request: https://github.com/apache/spark/pull/537 Add recursive directory file search to fileInputStream Added recursive directory search to fileInputStream. Want spark to be able to find files in the subdirectories rather than just the parent