GitHub user gvramana opened a pull request:

    https://github.com/apache/spark/pull/4893

    Rebased and merged to update with latest apache-spark/master

    Author: Venkata Ramana G <[email protected]>

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/Huawei-Spark/spark rebased_to_latest_spark

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/4893.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4893
    
----
commit 14cc397f71d1abeb3a372f346a60d649e33de65b
Author: Bo Meng <[email protected]>
Date:   2015-01-22T21:40:37Z

    initial integration

commit b325dbc0982eaaa3190d4c447b95cd0506b32120
Author: Bo Meng <[email protected]>
Date:   2015-01-22T22:00:10Z

    Fix the errors in merging

commit 36cf50baa9ad1d87af7f11c6dd2286a3ba07c624
Author: Bo Meng <[email protected]>
Date:   2015-01-22T22:31:15Z

    modify pom.xml file

commit deecc81f03af6e9c446a355c3741f240146ede52
Author: Bo Meng <[email protected]>
Date:   2015-01-22T22:33:31Z

    Modify the BulkLoad by Yan

commit 54215e645dd0fd7cfe6b4842d38af14cb729b92b
Author: Bo Meng <[email protected]>
Date:   2015-01-22T22:42:50Z

    Modify the non-parallel BulkLoad

commit 9b4b214108922599a236030ee5a65e38af019d00
Author: xinyunh <[email protected]>
Date:   2015-01-22T23:39:38Z

    Modify the BulkLoad testcases

commit c6fc52a59d20800431ccd8ece73fdb1d21b05c12
Author: Bo Meng <[email protected]>
Date:   2015-01-22T23:45:16Z

    format codes

commit 1d30d485549591ba7f209240ea519b332b38816b
Author: xinyunh <[email protected]>
Date:   2015-01-23T00:00:07Z

    Close the HTable connection after computing

commit c7b9dc0973cbaba3589b605319b2766266a10c26
Author: BI Hadoop <bihadoop@bi20.(none)>
Date:   2015-01-24T04:55:56Z

    yan: fixed parallel blkloading hfile flush problem

commit 4cb76679e30cdf7b8ca7a6bdf203fba52fd55b8a
Author: sparksburnitt <[email protected]>
Date:   2015-01-24T04:58:13Z

    .

commit 13a8c828e07f0982847d49ac7acf789eee40bb5b
Author: Bo Meng <[email protected]>
Date:   2015-01-25T01:41:17Z

    remove println

commit bb0f0ae3f55d10f87c28eb2dba68022c9e951942
Author: scwf <[email protected]>
Date:   2015-01-25T05:13:32Z

    fix file not fund issue

commit c0ef15852d3fd8a12163d1a0b401826003d67cdd
Author: scwf <[email protected]>
Date:   2015-01-25T06:32:39Z

    added test for multi column family bulkloading

commit 1e4d0dd5bcefeadf4c2b165a48d541a9fe7d5f4b
Author: scwf <[email protected]>
Date:   2015-01-25T06:38:18Z

    added multi cf for para data load and also test for inputs of identical 
primary keys

commit 63610b2c71f9139f8470f0083739e61568f3aee9
Author: scwf <[email protected]>
Date:   2015-01-25T09:07:41Z

    fix inputs of identical primary keys issue for non-parallelized bulk load

commit 540a87097855b961291bef0f57414f194121e7da
Author: scwf <[email protected]>
Date:   2015-01-25T09:15:49Z

    intermingle data set for bulk loading and and some identical primary keys 
to make test robust

commit 4d1deb1815e9bba0f60d47f105a898d75a163b73
Author: scwf <[email protected]>
Date:   2015-01-25T09:21:16Z

    empty line issue in text file

commit d039aa100ddb72abe06660284256cbf939d31a8d
Author: scwf <[email protected]>
Date:   2015-01-25T14:52:49Z

    fix hbase partitioner bug and add test case for this bug

commit 726421b386a0a31296c309d8b7aa7516b0cccecb
Author: sparksburnitt <[email protected]>
Date:   2015-01-27T00:24:19Z

    xinyun: merged serial & parallel blkload into one class

commit 707882bba87a97f5e0bac6e64227e14dcf54eafa
Author: sparksburnitt <[email protected]>
Date:   2015-01-27T00:29:34Z

    xinyun: handle data-file lines with trailing nulls

commit f797a23355baa4c8d18df55e3a0737ded7fbad94
Author: xinyunh <[email protected]>
Date:   2015-01-27T00:53:48Z

    Fix the testcases for merged BulkLoad command

commit 917af00044eed22b85247768a7c1866fb0fb3389
Author: xinyunh <[email protected]>
Date:   2015-01-27T01:23:28Z

    Fix the testcases for BulkLoad

commit ce131aeed718fc8a935f0eda94b6fb8442a7652d
Author: sparksburnitt <[email protected]>
Date:   2015-01-28T21:01:11Z

    make some variables transient to avoid serialization/data-transfer overhead

commit 35eaa958925ce74df769a706add1618e199486ca
Author: Bo Meng <[email protected]>
Date:   2015-01-29T21:12:38Z

    find the correct location of root folder of hbase project

commit ca48e235b3a28d579c37c59fe6055485fbd97ac4
Author: Bo Meng <[email protected]>
Date:   2015-01-29T23:50:38Z

    fix style check

commit 240cbdbdbe95709f8b9fb4f69c61e416531418f8
Author: Bo Meng <[email protected]>
Date:   2015-01-30T00:34:11Z

    integration

commit 7457d19cd82baa1db5099c80b940156f6bb83418
Author: sparksburnitt <[email protected]>
Date:   2015-01-29T23:25:35Z

    add dbg statements when blkld writer is flushed, and after hfile commit

commit b8ed9ba949ef133f2dab3ab6bdfef0a21a32ad69
Author: xinyunh <[email protected]>
Date:   2015-02-02T21:35:46Z

    minimizing use of HBaseSQLContext

commit 0a85ad8b2286b3e6a73bd1c0a7cfc61f1aafd85d
Author: xinyunh <[email protected]>
Date:   2015-02-02T23:42:12Z

    Modify the TestHbase

commit babaffbde0a3c1d483260acfeb3b7187ae580137
Author: sparksburnitt <[email protected]>
Date:   2015-02-02T23:54:24Z

    Use DataBlockEncoding.FAST_DIFF

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to