[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Affects Versions: 0.98.0 >Reporter: rajeshbabu >Assignee: rajeshbabu > Fix For: 0.98.0 > > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch, > HBASE-9249_v8.patch, HBASE-9249_v8.patch, HBASE-9249_v9.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v9.patch This is what committed to trunk. Thanks all for reviews. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Affects Versions: 0.98.0 >Reporter: rajeshbabu >Assignee: rajeshbabu > Fix For: 0.98.0 > > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch, > HBASE-9249_v8.patch, HBASE-9249_v8.patch, HBASE-9249_v9.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[
https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
rajeshbabu updated HBASE-9249:
--
Attachment: HBASE-9249_v8.patch
PreCommit build failed with unexpected hudson problem. Retrying QA.
{code}
FATAL: Unable to delete script file /tmp/hudson1422193118764676423.sh
hudson.util.IOException2: remote file operation failed:
/tmp/hudson1422193118764676423.sh at hudson.remoting.Channel@419aad26:hadoop1
at hudson.FilePath.act(FilePath.java:905)
at hudson.FilePath.act(FilePath.java:882)
at hudson.FilePath.delete(FilePath.java:1291)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:101)
{code}
> Add cp hook before setting PONR in split
>
>
> Key: HBASE-9249
> URL: https://issues.apache.org/jira/browse/HBASE-9249
> Project: HBase
> Issue Type: Sub-task
>Affects Versions: 0.98.0
>Reporter: rajeshbabu
>Assignee: rajeshbabu
> Fix For: 0.98.0
>
> Attachments: HBASE-9249.patch, HBASE-9249_v2.patch,
> HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch,
> HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch,
> HBASE-9249_v8.patch, HBASE-9249_v8.patch
>
>
> This hook helps to perform split on user region and corresponding index
> region such that both will be split or none.
> With this hook split for user and index region as follows
> user region
> ===
> 1) Create splitting znode for user region split
> 2) Close parent user region
> 3) split user region storefiles
> 4) instantiate child regions of user region
> Through the new hook we can call index region transitions as below
> index region
> ===
> 5) Create splitting znode for index region split
> 6) Close parent index region
> 7) Split storefiles of index region
> 8) instantiate child regions of the index region
> If any failures in 5,6,7,8 rollback the steps and return null, on null return
> throw exception to rollback for 1,2,3,4
> 9) set PONR
> 10) do batch put of offline and split entries for user and index regions
> index region
>
> 11) open daughers of index regions and transition znode to split. This step
> we will do through preSplitAfterPONR hook. Opening index regions before
> opening user regions helps to avoid put failures if there is colocation
> mismatch(this can happen if user regions opening completed but index regions
> opening in progress)
> user region
> ===
> 12) open daughers of user regions and transition znode to split.
> Even if region server crashes also at the end both user and index regions
> will be split or none
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v8.patch Rebased patch as for the latest code. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Affects Versions: 0.98.0 >Reporter: rajeshbabu >Assignee: rajeshbabu > Fix For: 0.98.0 > > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch, > HBASE-9249_v8.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-9249: -- Attachment: (was: HBASE-9249_v7.patch) > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-9249: -- Fix Version/s: 0.98.0 Affects Version/s: 0.98.0 Status: Patch Available (was: Open) > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Affects Versions: 0.98.0 >Reporter: rajeshbabu >Assignee: rajeshbabu > Fix For: 0.98.0 > > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-9249: -- Status: Open (was: Patch Available) > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HBASE-9249: -- Attachment: HBASE-9249_v7.patch Try running QA against this patch > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v7.patch Reattaching the same patch.findbugs introduced not related to this patch. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch, HBASE-9249_v7.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v7.patch Patch addressing Ram's comment. Changed puts to mutations. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch, HBASE-9249_v7.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v6.patch Patch addressing Anoop's comments. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch, > HBASE-9249_v6.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v5.patch bq. Both actual and index region got split. We would like to write to Meta both the data (daughter region entries) as one Put. For that there should be some provision provided in this beforePONR or after PONR CP hook so that that can change what is getting written to META tabl?. Do how we handle in case of batch put. We pass the WALEdit also to the hook. Hook can change it and finally core writes the resultant edit.. Same way can follow here also? Its good idea Anoop,better to collect puts(if any is needed) from preSplitBeforePONR hook and insert along while offlining user region atomically. With this approach there wont be any kernel changes later. Handled same in current patch and also throwing IOE on bypass in preSplitBeforePONR hook so we can rollback the transaction. Added test case to verify hooks and puts from coprocessors. Please review. Thanks. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch, HBASE-9249_v5.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v4.patch Fixing javadoc and findbug warnings. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch, HBASE-9249_v4.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v3.patch Patch addressing Andrew's comment. Thanks for review > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu >Assignee: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch, > HBASE-9249_v3.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249_v2.patch Thanks for review Stack and Ram. Patch addressing the review comments. > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu > Attachments: HBASE-9249.patch, HBASE-9249_v2.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Description: This hook helps to perform split on user region and corresponding index region such that both will be split or none. With this hook split for user and index region as follows user region === 1) Create splitting znode for user region split 2) Close parent user region 3) split user region storefiles 4) instantiate child regions of user region Through the new hook we can call index region transitions as below index region === 5) Create splitting znode for index region split 6) Close parent index region 7) Split storefiles of index region 8) instantiate child regions of the index region If any failures in 5,6,7,8 rollback the steps and return null, on null return throw exception to rollback for 1,2,3,4 9) set PONR 10) do batch put of offline and split entries for user and index regions index region 11) open daughers of index regions and transition znode to split. This step we will do through preSplitAfterPONR hook. Opening index regions before opening user regions helps to avoid put failures if there is colocation mismatch(this can happen if user regions opening completed but index regions opening in progress) user region === 12) open daughers of user regions and transition znode to split. Even if region server crashes also at the end both user and index regions will be split or none was: This hook helps to perform split on user region and corresponding index region such that both will be split or none. With this hook split for user and index region as follows user region === 1) Create splitting znode for user region split 2) Close parent user region 3) split user region storefiles 4) instantiate child regions of user region Through the new hook we can call index region transitions as below index region === 5) Create splitting znode for index region split 6) Close parent index region 7) Split storefiles of index region 8) instantiate child regions of the index region If any failures in 5,6,7,8 rollback the steps and return null, on null return throw exception to rollback for 1,2,3,4 9) set PONR 10) do batch put of offline and split entries for user and index regions index region 11) open daughers of index regions and transition znode to split. This step we will do through user region === 12) open daughers of user regions and transition znode to split. We can open index region daughters and transition znode to split through postSplit hook which is already present. Even if region server crashes also at the end both user and index regions will be split or none > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu > Attachments: HBASE-9249.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through preSplitAfterPONR hook. Opening index regions before > opening user regions helps to avoid put failures if there is colocation > mismatch(this can happen if user regions opening completed but index regions > opening in progress) > user region > === > 12) open daughers of user regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Description: This hook helps to perform split on user region and corresponding index region such that both will be split or none. With this hook split for user and index region as follows user region === 1) Create splitting znode for user region split 2) Close parent user region 3) split user region storefiles 4) instantiate child regions of user region Through the new hook we can call index region transitions as below index region === 5) Create splitting znode for index region split 6) Close parent index region 7) Split storefiles of index region 8) instantiate child regions of the index region If any failures in 5,6,7,8 rollback the steps and return null, on null return throw exception to rollback for 1,2,3,4 9) set PONR 10) do batch put of offline and split entries for user and index regions index region 11) open daughers of index regions and transition znode to split. This step we will do through user region === 12) open daughers of user regions and transition znode to split. We can open index region daughters and transition znode to split through postSplit hook which is already present. Even if region server crashes also at the end both user and index regions will be split or none was: This hook helps to perform split on user region and corresponding index region such that both will be split or none. With this hook split for user and index region as follows user region === 1) Create splitting znode for user region split 2) Close parent user region 3) split user region storefiles 4) instantiate child regions of user region Through the new hook we can call index region transitions as below index region === 5) Create splitting znode for index region split 6) Close parent index region 7) Split storefiles of index region 8) instantiate child regions of the index region If any failures in 5,6,7,8 rollback the steps and return null, on null return throw exception to rollback for 1,2,3,4 9) set PONR 10) do batch put of offline and split entries for user and index regions user region === 11) open daughers of user regions and transition znode to split. We can open index region daughters and transition znode to split through postSplit hook which is already present. index region 12) open daughers of index regions and transition znode to split. Even if region server crashes also at the end both user and index regions will be split or none > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu > Attachments: HBASE-9249.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > index region > > 11) open daughers of index regions and transition znode to split. This step > we will do through > user region > === > 12) open daughers of user regions and transition znode to split. > We can open index region daughters and transition znode to split through > postSplit hook which is already present. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Attachment: HBASE-9249.patch Patch for trunk > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu > Attachments: HBASE-9249.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > user region > === > 11) open daughers of user regions and transition znode to split. > We can open index region daughters and transition znode to split through > postSplit hook which is already present. > index region > > 12) open daughers of index regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Status: Patch Available (was: Open) > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu > Attachments: HBASE-9249.patch > > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > user region > === > 11) open daughers of user regions and transition znode to split. > We can open index region daughters and transition znode to split through > postSplit hook which is already present. > index region > > 12) open daughers of index regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-9249) Add cp hook before setting PONR in split
[ https://issues.apache.org/jira/browse/HBASE-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-9249: -- Description: This hook helps to perform split on user region and corresponding index region such that both will be split or none. With this hook split for user and index region as follows user region === 1) Create splitting znode for user region split 2) Close parent user region 3) split user region storefiles 4) instantiate child regions of user region Through the new hook we can call index region transitions as below index region === 5) Create splitting znode for index region split 6) Close parent index region 7) Split storefiles of index region 8) instantiate child regions of the index region If any failures in 5,6,7,8 rollback the steps and return null, on null return throw exception to rollback for 1,2,3,4 9) set PONR 10) do batch put of offline and split entries for user and index regions user region === 11) open daughers of user regions and transition znode to split. We can open index region daughters and transition znode to split through postSplit hook which is already present. index region 12) open daughers of index regions and transition znode to split. Even if region server crashes also at the end both user and index regions will be split or none was: This hook helps to perform split on user region and corresponding index region such that both will be split or none. With this hook split for user and index region as follows user region === 1) Create splitting znode for user region split 2) Close parent user region 3) split user region storefiles 4) instantiate child regions of user region index region === 5) Create splitting znode for index region split 6) Close parent index region 7) Split storefiles of index region 8) instantiate child regions of the index region If any failures in 5,6,7,8 rollback the steps and return null, on null return throw exception to rollback for 1,2,3,4 9) set PONR 10) do batch put of offline and split entries for user and index regions user region === 11) open daughers of user regions and transition znode to split. index region 12) open daughers of index regions and transition znode to split. Even if region server crashes also at the end both user and index regions will be split or none > Add cp hook before setting PONR in split > > > Key: HBASE-9249 > URL: https://issues.apache.org/jira/browse/HBASE-9249 > Project: HBase > Issue Type: Sub-task >Reporter: rajeshbabu > > This hook helps to perform split on user region and corresponding index > region such that both will be split or none. > With this hook split for user and index region as follows > user region > === > 1) Create splitting znode for user region split > 2) Close parent user region > 3) split user region storefiles > 4) instantiate child regions of user region > Through the new hook we can call index region transitions as below > index region > === > 5) Create splitting znode for index region split > 6) Close parent index region > 7) Split storefiles of index region > 8) instantiate child regions of the index region > If any failures in 5,6,7,8 rollback the steps and return null, on null return > throw exception to rollback for 1,2,3,4 > 9) set PONR > 10) do batch put of offline and split entries for user and index regions > user region > === > 11) open daughers of user regions and transition znode to split. > We can open index region daughters and transition znode to split through > postSplit hook which is already present. > index region > > 12) open daughers of index regions and transition znode to split. > Even if region server crashes also at the end both user and index regions > will be split or none -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
