[
https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ramkrishna.s.vasudevan updated HBASE-18649:
-------------------------------------------
Attachment: HBASE-18649_master_5.patch
Updated patch for master branch. The main difference is that we are not
expecting the Cell to be of type ExtendedCell in the MR code instead the
MapReduceCell is still of type ExtendedCell and the cell it wraps uses the
CellUtil's newly added methods to make use of the ExtendedCell properties. (If
you feel the new methods are not needed in CellUtl then we should move them to
some MRUtil class).
So the plan for branch-2 should be add the new CellSorrtReducer,
CellSerialization to the code base and mark the KVSortReducer, KVSerialization
as deprecated. This also applies to some of the mappers, reducers, and sorters
inside the Import.java. The branch-2 code will be made to work with
MapReduceCell only and we can mark things as incompatible change.
Those who are using the KVSortREducer and KVSerialization in their custom job
will still be able to run for branch-2. How ever if some one is using
HFileOutptFormat2 of branch-2 (after this commit) he can be sure that
internally we have already set the mapper value type to MapREduceCell and so we
are safe. Pls give feedback on this. So that accordingly I can prepare a patch
for branch-2 with a new subtask so that it is clear.
> Deprecate KV Usage in MR to move to Cells in 3.0
> ------------------------------------------------
>
> Key: HBASE-18649
> URL: https://issues.apache.org/jira/browse/HBASE-18649
> Project: HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 2.0.0-alpha-2
> Reporter: ramkrishna.s.vasudevan
> Assignee: ramkrishna.s.vasudevan
> Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4
>
> Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch,
> HBASE-18649_master_3.patch, HBASE-18649_master_5.patch,
> HBASE-18649_master.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
