[jira] [Updated] (HBASE-21171) [amv2] Tool to parse a directory of MasterProcWALs standalone

2018-09-09 Thread stack (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-21171:
--
   Resolution: Fixed
 Hadoop Flags: Reviewed
Fix Version/s: 2.1.1
   2.2.0
   3.0.0
   Status: Resolved  (was: Patch Available)

Pushed to branch-2.1. Thanks for review.

> [amv2] Tool to parse a directory of MasterProcWALs standalone
> -
>
> Key: HBASE-21171
> URL: https://issues.apache.org/jira/browse/HBASE-21171
> Project: HBase
>  Issue Type: Bug
>  Components: amv2, test
>Reporter: stack
>Assignee: stack
>Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.1.1
>
> Attachments: HBASE-21171.branch-2.1.001.patch, 
> HBASE-21171.branch-2.1.002.patch, HBASE-21171.branch-2.1.003.patch
>
>
> I want to be able to test parsing and be able to profile a standalone parse 
> and WALProcedureStore load of procedures. Adding a simple main on 
> WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds 
> of WALs to see what is going on when we try to load. Good for figuring how to 
> log, where the memory is going, etc., in this subsystem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21171) [amv2] Tool to parse a directory of MasterProcWALs standalone

2018-09-08 Thread stack (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-21171:
--
Attachment: HBASE-21171.branch-2.1.003.patch

> [amv2] Tool to parse a directory of MasterProcWALs standalone
> -
>
> Key: HBASE-21171
> URL: https://issues.apache.org/jira/browse/HBASE-21171
> Project: HBase
>  Issue Type: Bug
>  Components: amv2, test
>Reporter: stack
>Assignee: stack
>Priority: Major
> Attachments: HBASE-21171.branch-2.1.001.patch, 
> HBASE-21171.branch-2.1.002.patch, HBASE-21171.branch-2.1.003.patch
>
>
> I want to be able to test parsing and be able to profile a standalone parse 
> and WALProcedureStore load of procedures. Adding a simple main on 
> WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds 
> of WALs to see what is going on when we try to load. Good for figuring how to 
> log, where the memory is going, etc., in this subsystem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21171) [amv2] Tool to parse a directory of MasterProcWALs standalone

2018-09-08 Thread stack (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-21171:
--
Attachment: HBASE-21171.branch-2.1.002.patch

> [amv2] Tool to parse a directory of MasterProcWALs standalone
> -
>
> Key: HBASE-21171
> URL: https://issues.apache.org/jira/browse/HBASE-21171
> Project: HBase
>  Issue Type: Bug
>  Components: amv2, test
>Reporter: stack
>Assignee: stack
>Priority: Major
> Attachments: HBASE-21171.branch-2.1.001.patch, 
> HBASE-21171.branch-2.1.002.patch
>
>
> I want to be able to test parsing and be able to profile a standalone parse 
> and WALProcedureStore load of procedures. Adding a simple main on 
> WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds 
> of WALs to see what is going on when we try to load. Good for figuring how to 
> log, where the memory is going, etc., in this subsystem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21171) [amv2] Tool to parse a directory of MasterProcWALs standalone

2018-09-07 Thread stack (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-21171:
--
Release Note: 
Make it so can run the WAL parse and load system in isolation. Here is an 
example:

{code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions 
-XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" 
./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore 
~/big_set_of_masterprocwals/
{code}
  Status: Patch Available  (was: Open)

> [amv2] Tool to parse a directory of MasterProcWALs standalone
> -
>
> Key: HBASE-21171
> URL: https://issues.apache.org/jira/browse/HBASE-21171
> Project: HBase
>  Issue Type: Bug
>  Components: amv2, test
>Reporter: stack
>Assignee: stack
>Priority: Major
> Attachments: HBASE-21171.branch-2.1.001.patch
>
>
> I want to be able to test parsing and be able to profile a standalone parse 
> and WALProcedureStore load of procedures. Adding a simple main on 
> WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds 
> of WALs to see what is going on when we try to load. Good for figuring how to 
> log, where the memory is going, etc., in this subsystem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HBASE-21171) [amv2] Tool to parse a directory of MasterProcWALs standalone

2018-09-07 Thread stack (JIRA)


 [ 
https://issues.apache.org/jira/browse/HBASE-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

stack updated HBASE-21171:
--
Attachment: HBASE-21171.branch-2.1.001.patch

> [amv2] Tool to parse a directory of MasterProcWALs standalone
> -
>
> Key: HBASE-21171
> URL: https://issues.apache.org/jira/browse/HBASE-21171
> Project: HBase
>  Issue Type: Bug
>  Components: amv2, test
>Reporter: stack
>Assignee: stack
>Priority: Major
> Attachments: HBASE-21171.branch-2.1.001.patch
>
>
> I want to be able to test parsing and be able to profile a standalone parse 
> and WALProcedureStore load of procedures. Adding a simple main on 
> WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds 
> of WALs to see what is going on when we try to load. Good for figuring how to 
> log, where the memory is going, etc., in this subsystem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)