[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to master also. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 3.0.0, 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Hadoop Flags: Incompatible change,Reviewed > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Release Note: All the mappers and reducers output type will be now of MapReduceCell type. No more KeyValue type. How ever in branch-2 for compatibility we have allowed the older interfaces/classes that work with KeyValue to stay in the code base but they have been marked as deprecated. The following interfaces/classes have been deprecated in branch-2 Import#KeyValueWritableComparablePartitioner Import#KeyValueWritableComparator Import#KeyValueWritableComparable Import#KeyValueReducer Import#KeyValueSortImporter Import#KeyValueImporter KeyValueSortReducer KeyValueSerialization WALPlayer#WALKeyValueMapper So any existing MR jobs that is using the above public interfaces/classes will continue to work in branch-2 and the expected output value type of those mappers and reducers can continue to be KeyValue type. In branch-3 the mappers and reducers output will only expect MapReduceCell as the type and will no longer work with KeyValue type. The new public classes/interfaces added for branch-3 and in branch-2 are CellSerialization CellSortReducer Import#CellWritableComparablePartitioner Import#CellWritableComparable Import#CellWritableComparator Import#CellReducer Import#CellSortImporter Import#CellImporter WALPlayer#WALCellMapper > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_master_6.patch Retry QA for master before committing. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649-branch-2_2.patch Patch as per Stack's comment. Left the old test cases to work with KV based Mappers and reducers. Added new test classes to work with Cell based mappers and reducers. [~saint@gmail.com] Pls have a look and need your blessings for commit. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Fix Version/s: (was: 2.0.0-alpha-4) 2.0.0-beta-1 Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-beta-1 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649-branch-2_2.patch, HBASE-18649_branch-2.patch, > HBASE-18649-branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-alpha-4 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-18649: -- Component/s: API > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: API, mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-alpha-4 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-18649: -- Fix Version/s: (was: 2.1.0) (was: 3.0.0) (was: 2.0.0) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0-alpha-4 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649-branch-2_1.patch Patch for branch-2 for QA. Cleared the whitespace warnings. All tests seems to have already passed. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649-branch-2_1.patch, > HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649-branch-2.patch Patch for branch-2. It has all the existing KV based mappers, reducers etc but with @Deprecated tag. So someone trying to use the Import.java in branch-1 (as MR client) it will just work because the expected classes are still available. [~saint@gmail.com] - Pls have a look. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649-branch-2.patch, > HBASE-18649_master_2.patch, HBASE-18649_master_3.patch, > HBASE-18649_master_5.patch, HBASE-18649_master_6.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_master_6.patch Patch that corrects the test case failures and other QA warnings. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master_6.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Fix Version/s: 2.0.0-alpha-4 > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_master_5.patch Updated patch for master branch. The main difference is that we are not expecting the Cell to be of type ExtendedCell in the MR code instead the MapReduceCell is still of type ExtendedCell and the cell it wraps uses the CellUtil's newly added methods to make use of the ExtendedCell properties. (If you feel the new methods are not needed in CellUtl then we should move them to some MRUtil class). So the plan for branch-2 should be add the new CellSorrtReducer, CellSerialization to the code base and mark the KVSortReducer, KVSerialization as deprecated. This also applies to some of the mappers, reducers, and sorters inside the Import.java. The branch-2 code will be made to work with MapReduceCell only and we can mark things as incompatible change. Those who are using the KVSortREducer and KVSerialization in their custom job will still be able to run for branch-2. How ever if some one is using HFileOutptFormat2 of branch-2 (after this commit) he can be sure that internally we have already set the mapper value type to MapREduceCell and so we are safe. Pls give feedback on this. So that accordingly I can prepare a patch for branch-2 with a new subtask so that it is clear. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0, 2.0.0-alpha-4 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master_5.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_master_3.patch Patch for master. Renames all KeyValuereducer, KVSorter, KVWritables etc to CellReducer, CellSorter etc. Renamed ExtendedCell to MapReduceCell. Corrected the failing test cases. [~saint@gmail.com] - Ping for reviews on latest patch. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master_3.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_branch-2.patch Patch for branch-2. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_branch-2.patch, HBASE-18649_master_2.patch, > HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_master_2.patch An updated patch. All test cases passes hbase-backup. Key thing to note is that a new Cell type called ExtendedCellWrapper(better name needed) in the hbase-mapreduce package. It wraps all the cells in the mappers/reducers so that the downstream code can safely work with ExtendedCell/Cells. And other main thing is that the output value class should be an implementation rather than an interface. [~saint@gmail.com] Thanks for the review. For the new BBUtil API since it is a write to DataOutput there is no need to return an int I think. If you strongly feel otherwise I can add one. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_master_2.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_master_2.patch, HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Open (was: Patch Available) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Status: Patch Available (was: Open) > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Attachment: HBASE-18649_master.patch Patch for master. Lets try QA. Ran the test case in hbase-mapreduce module like TestImportExport, TestImportTsv, TestHFileOutputformat2 etc.All seems to pass. So in branch-2 we should deprecate all the mapreduce classes indicating that we are moving to Cell and the CellUtil API that wil now work on DataOutput rather than DataOutputStream. > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > Attachments: HBASE-18649_master.patch > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HBASE-18649) Deprecate KV Usage in MR to move to Cells in 3.0
[ https://issues.apache.org/jira/browse/HBASE-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated HBASE-18649: --- Fix Version/s: 2.1.0 2.0.0 > Deprecate KV Usage in MR to move to Cells in 3.0 > > > Key: HBASE-18649 > URL: https://issues.apache.org/jira/browse/HBASE-18649 > Project: HBase > Issue Type: Improvement > Components: mapreduce >Affects Versions: 2.0.0-alpha-2 >Reporter: ramkrishna.s.vasudevan >Assignee: ramkrishna.s.vasudevan > Fix For: 2.0.0, 3.0.0, 2.1.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
