GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/6588
[SPARK-3586][streaming]Support nested directories in Spark Streaming Closes #2765 You can merge this pull request into a Git repository by running: $ git pull https://github.com/zsxwing/spark pr2765 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6588.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6588 ---- commit 4a7eef4ceb32c627644d367dcfbf52cb73899e9d Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-11T08:22:31Z Support nested directories in Spark Streaming commit 50ad7d40a1317da9264c7c67e52328fdec63e52c Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-12T05:27:22Z change Nit commit c14def13058d96ad2fcffd8e3039dd1c248a7612 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-17T03:46:01Z support depth commit bfbec510d8963a2382ec29abc20b2b6208edce12 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-17T06:22:12Z Change space before brace commit 0a8ecf8079560b5f581dda983e35a186db483f3a Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-17T07:24:38Z change process any files created in nested directories commit 1ce623d37a7c23149d630687a9c015aa15152ff9 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-24T07:12:17Z reformat code commit fe6e5ca2a61bc473cedcf1e0e982c05dce441d20 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-24T07:54:09Z add a require(depth >= 0) commit 70319401d068b9b4c58cfca957e4612941be7300 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-24T08:54:03Z reformat code commit 7bd4811358de035b75c61ae50f5cffbde8fa31a0 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-28T02:52:01Z change performance commit 05b5fba4a8944c6942f01f36f3381c46d2d0a7f2 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-10-28T08:48:37Z change filter name commit e66b16650d4f7fedea0a96b881b988f5564fc7bb Author: wangxiaojing <u9j...@gmail.com> Date: 2014-11-03T09:55:46Z change line exceeds 100 columns commit a63c5a3fa63f68a8179c9f61ad6e75886597c8c8 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-11-10T05:47:09Z line over 100 commit 0b4812eef0ab065b7ef5a6b2e2a269baa6bfe542 Author: wangxiaojing <u9j...@gmail.com> Date: 2014-12-04T09:27:12Z remove line commit 8990c3576ae91bc822dece2d1ef8a63a0465d13e Author: wangxiaojing <u9j...@gmail.com> Date: 2014-12-04T10:21:19Z style commit a20743f5946310f1babcd0815be0363ae4bd470a Author: wangxiaojing <u9j...@gmail.com> Date: 2014-12-17T04:49:36Z change get depth commit d7f4880903f4b270bd1be2a5261fdc0b2403234b Author: wangxiaojing <u9j...@gmail.com> Date: 2014-12-24T06:07:43Z Use 'isDir' to modify the compatibility commit 99b05d6c6851b9f7184139d5d8ed40b27c861971 Author: wangxiaojing <u9j...@gmail.com> Date: 2015-01-07T09:36:30Z rebase commit b6788a366e54575ce2fef7055fb3ffa093357fb9 Author: wangxiaojing <u9j...@gmail.com> Date: 2015-01-12T05:26:59Z support java Api commit d2f606c80ee77aaf29ad57ec765312f5700a990f Author: wangxiaojing <u9j...@gmail.com> Date: 2015-01-12T11:18:02Z Add support python api commit 8e3a0544d93abe4c518ba1b05954688e5a41dfae Author: wangxiaojing <u9j...@gmail.com> Date: 2015-01-13T03:20:07Z Additional excludes for checking of Spark's binary compatibility commit 571730ade679f07c1cc1e04ad8b6778d611e565f Author: wangxiaojing <u9j...@gmail.com> Date: 2015-01-30T05:58:48Z rebase commit a4bfac244d637cf65a582c2ffc54b6daaa744dda Author: wangxiaojing <u9j...@gmail.com> Date: 2015-02-27T09:02:01Z rebase commit 5e3fd3d79d85085ca3ac71a81b497391ee9a0e3e Author: wangxiaojing <u9j...@gmail.com> Date: 2015-02-28T04:03:49Z change API commit e4b9c22f85aca7cc81b71646ffec77706cbcbe6e Author: wangxiaojing <u9j...@gmail.com> Date: 2015-03-02T07:54:42Z change MiMa failures commit 1a2aae91bbf39e0d1546e2e135f6428946410420 Author: wangxiaojing <u9j...@gmail.com> Date: 2015-05-20T07:25:10Z rebase commit 0a916cc893f2a597850f80c7be75829bfb57a970 Author: zsxwing <zsxw...@gmail.com> Date: 2015-06-02T12:33:04Z Merge branch 'master' into pr2765 commit 26dce26d4bc513e6fefe28f767b4802b3b76e3b4 Author: zsxwing <zsxw...@gmail.com> Date: 2015-06-02T12:47:00Z Address comments commit 2d85159fdd5c603edbe9938f2b12f7137d326c81 Author: zsxwing <zsxw...@gmail.com> Date: 2015-06-02T14:01:04Z Refactor PR and handle some corner cases ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org