GitHub user zsxwing opened a pull request:

    https://github.com/apache/spark/pull/6588

    [SPARK-3586][streaming]Support nested directories in Spark Streaming

    Closes #2765

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/zsxwing/spark pr2765

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/6588.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #6588
    
----
commit 4a7eef4ceb32c627644d367dcfbf52cb73899e9d
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-11T08:22:31Z

    Support nested directories in Spark Streaming

commit 50ad7d40a1317da9264c7c67e52328fdec63e52c
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-12T05:27:22Z

    change Nit

commit c14def13058d96ad2fcffd8e3039dd1c248a7612
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-17T03:46:01Z

    support depth

commit bfbec510d8963a2382ec29abc20b2b6208edce12
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-17T06:22:12Z

    Change space before brace

commit 0a8ecf8079560b5f581dda983e35a186db483f3a
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-17T07:24:38Z

    change process any files created in nested directories

commit 1ce623d37a7c23149d630687a9c015aa15152ff9
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-24T07:12:17Z

    reformat code

commit fe6e5ca2a61bc473cedcf1e0e982c05dce441d20
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-24T07:54:09Z

    add a require(depth >= 0)

commit 70319401d068b9b4c58cfca957e4612941be7300
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-24T08:54:03Z

    reformat code

commit 7bd4811358de035b75c61ae50f5cffbde8fa31a0
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-28T02:52:01Z

    change performance

commit 05b5fba4a8944c6942f01f36f3381c46d2d0a7f2
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-10-28T08:48:37Z

    change filter name

commit e66b16650d4f7fedea0a96b881b988f5564fc7bb
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-11-03T09:55:46Z

    change line exceeds 100 columns

commit a63c5a3fa63f68a8179c9f61ad6e75886597c8c8
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-11-10T05:47:09Z

    line over 100

commit 0b4812eef0ab065b7ef5a6b2e2a269baa6bfe542
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-12-04T09:27:12Z

    remove line

commit 8990c3576ae91bc822dece2d1ef8a63a0465d13e
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-12-04T10:21:19Z

    style

commit a20743f5946310f1babcd0815be0363ae4bd470a
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-12-17T04:49:36Z

    change get depth

commit d7f4880903f4b270bd1be2a5261fdc0b2403234b
Author: wangxiaojing <u9j...@gmail.com>
Date:   2014-12-24T06:07:43Z

    Use 'isDir' to  modify the compatibility

commit 99b05d6c6851b9f7184139d5d8ed40b27c861971
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-01-07T09:36:30Z

    rebase

commit b6788a366e54575ce2fef7055fb3ffa093357fb9
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-01-12T05:26:59Z

    support java Api

commit d2f606c80ee77aaf29ad57ec765312f5700a990f
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-01-12T11:18:02Z

    Add support python api

commit 8e3a0544d93abe4c518ba1b05954688e5a41dfae
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-01-13T03:20:07Z

    Additional excludes for checking of Spark's binary compatibility

commit 571730ade679f07c1cc1e04ad8b6778d611e565f
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-01-30T05:58:48Z

    rebase

commit a4bfac244d637cf65a582c2ffc54b6daaa744dda
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-02-27T09:02:01Z

    rebase

commit 5e3fd3d79d85085ca3ac71a81b497391ee9a0e3e
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-02-28T04:03:49Z

    change API

commit e4b9c22f85aca7cc81b71646ffec77706cbcbe6e
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-03-02T07:54:42Z

    change MiMa  failures

commit 1a2aae91bbf39e0d1546e2e135f6428946410420
Author: wangxiaojing <u9j...@gmail.com>
Date:   2015-05-20T07:25:10Z

    rebase

commit 0a916cc893f2a597850f80c7be75829bfb57a970
Author: zsxwing <zsxw...@gmail.com>
Date:   2015-06-02T12:33:04Z

    Merge branch 'master' into pr2765

commit 26dce26d4bc513e6fefe28f767b4802b3b76e3b4
Author: zsxwing <zsxw...@gmail.com>
Date:   2015-06-02T12:47:00Z

    Address comments

commit 2d85159fdd5c603edbe9938f2b12f7137d326c81
Author: zsxwing <zsxw...@gmail.com>
Date:   2015-06-02T14:01:04Z

    Refactor PR and handle some corner cases

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to