GitHub user gvramana opened a pull request:
https://github.com/apache/spark/pull/4893
Rebased and merged to update with latest apache-spark/master
Author: Venkata Ramana G <[email protected]>
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Huawei-Spark/spark rebased_to_latest_spark
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4893.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4893
----
commit 14cc397f71d1abeb3a372f346a60d649e33de65b
Author: Bo Meng <[email protected]>
Date: 2015-01-22T21:40:37Z
initial integration
commit b325dbc0982eaaa3190d4c447b95cd0506b32120
Author: Bo Meng <[email protected]>
Date: 2015-01-22T22:00:10Z
Fix the errors in merging
commit 36cf50baa9ad1d87af7f11c6dd2286a3ba07c624
Author: Bo Meng <[email protected]>
Date: 2015-01-22T22:31:15Z
modify pom.xml file
commit deecc81f03af6e9c446a355c3741f240146ede52
Author: Bo Meng <[email protected]>
Date: 2015-01-22T22:33:31Z
Modify the BulkLoad by Yan
commit 54215e645dd0fd7cfe6b4842d38af14cb729b92b
Author: Bo Meng <[email protected]>
Date: 2015-01-22T22:42:50Z
Modify the non-parallel BulkLoad
commit 9b4b214108922599a236030ee5a65e38af019d00
Author: xinyunh <[email protected]>
Date: 2015-01-22T23:39:38Z
Modify the BulkLoad testcases
commit c6fc52a59d20800431ccd8ece73fdb1d21b05c12
Author: Bo Meng <[email protected]>
Date: 2015-01-22T23:45:16Z
format codes
commit 1d30d485549591ba7f209240ea519b332b38816b
Author: xinyunh <[email protected]>
Date: 2015-01-23T00:00:07Z
Close the HTable connection after computing
commit c7b9dc0973cbaba3589b605319b2766266a10c26
Author: BI Hadoop <bihadoop@bi20.(none)>
Date: 2015-01-24T04:55:56Z
yan: fixed parallel blkloading hfile flush problem
commit 4cb76679e30cdf7b8ca7a6bdf203fba52fd55b8a
Author: sparksburnitt <[email protected]>
Date: 2015-01-24T04:58:13Z
.
commit 13a8c828e07f0982847d49ac7acf789eee40bb5b
Author: Bo Meng <[email protected]>
Date: 2015-01-25T01:41:17Z
remove println
commit bb0f0ae3f55d10f87c28eb2dba68022c9e951942
Author: scwf <[email protected]>
Date: 2015-01-25T05:13:32Z
fix file not fund issue
commit c0ef15852d3fd8a12163d1a0b401826003d67cdd
Author: scwf <[email protected]>
Date: 2015-01-25T06:32:39Z
added test for multi column family bulkloading
commit 1e4d0dd5bcefeadf4c2b165a48d541a9fe7d5f4b
Author: scwf <[email protected]>
Date: 2015-01-25T06:38:18Z
added multi cf for para data load and also test for inputs of identical
primary keys
commit 63610b2c71f9139f8470f0083739e61568f3aee9
Author: scwf <[email protected]>
Date: 2015-01-25T09:07:41Z
fix inputs of identical primary keys issue for non-parallelized bulk load
commit 540a87097855b961291bef0f57414f194121e7da
Author: scwf <[email protected]>
Date: 2015-01-25T09:15:49Z
intermingle data set for bulk loading and and some identical primary keys
to make test robust
commit 4d1deb1815e9bba0f60d47f105a898d75a163b73
Author: scwf <[email protected]>
Date: 2015-01-25T09:21:16Z
empty line issue in text file
commit d039aa100ddb72abe06660284256cbf939d31a8d
Author: scwf <[email protected]>
Date: 2015-01-25T14:52:49Z
fix hbase partitioner bug and add test case for this bug
commit 726421b386a0a31296c309d8b7aa7516b0cccecb
Author: sparksburnitt <[email protected]>
Date: 2015-01-27T00:24:19Z
xinyun: merged serial & parallel blkload into one class
commit 707882bba87a97f5e0bac6e64227e14dcf54eafa
Author: sparksburnitt <[email protected]>
Date: 2015-01-27T00:29:34Z
xinyun: handle data-file lines with trailing nulls
commit f797a23355baa4c8d18df55e3a0737ded7fbad94
Author: xinyunh <[email protected]>
Date: 2015-01-27T00:53:48Z
Fix the testcases for merged BulkLoad command
commit 917af00044eed22b85247768a7c1866fb0fb3389
Author: xinyunh <[email protected]>
Date: 2015-01-27T01:23:28Z
Fix the testcases for BulkLoad
commit ce131aeed718fc8a935f0eda94b6fb8442a7652d
Author: sparksburnitt <[email protected]>
Date: 2015-01-28T21:01:11Z
make some variables transient to avoid serialization/data-transfer overhead
commit 35eaa958925ce74df769a706add1618e199486ca
Author: Bo Meng <[email protected]>
Date: 2015-01-29T21:12:38Z
find the correct location of root folder of hbase project
commit ca48e235b3a28d579c37c59fe6055485fbd97ac4
Author: Bo Meng <[email protected]>
Date: 2015-01-29T23:50:38Z
fix style check
commit 240cbdbdbe95709f8b9fb4f69c61e416531418f8
Author: Bo Meng <[email protected]>
Date: 2015-01-30T00:34:11Z
integration
commit 7457d19cd82baa1db5099c80b940156f6bb83418
Author: sparksburnitt <[email protected]>
Date: 2015-01-29T23:25:35Z
add dbg statements when blkld writer is flushed, and after hfile commit
commit b8ed9ba949ef133f2dab3ab6bdfef0a21a32ad69
Author: xinyunh <[email protected]>
Date: 2015-02-02T21:35:46Z
minimizing use of HBaseSQLContext
commit 0a85ad8b2286b3e6a73bd1c0a7cfc61f1aafd85d
Author: xinyunh <[email protected]>
Date: 2015-02-02T23:42:12Z
Modify the TestHbase
commit babaffbde0a3c1d483260acfeb3b7187ae580137
Author: sparksburnitt <[email protected]>
Date: 2015-02-02T23:54:24Z
Use DataBlockEncoding.FAST_DIFF
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]