[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551378#comment-14551378 ] Esteban Gutierrez commented on HBASE-12446: --- [~manukranthk] I will grab it, I've been a little busy but this stills under my radar. Thanks! > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551239#comment-14551239 ] Jean-Marc Spaggiari commented on HBASE-12446: - Any progress here? > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266875#comment-14266875 ] Manukranth Kolloju commented on HBASE-12446: Thats great. We can merge both the patches and expose an Admin endpoint to provide shell commands. > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Fix For: 1.1.0 > > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266862#comment-14266862 ] Esteban Gutierrez commented on HBASE-12446: --- Nice work [~manukranthk]. I think we went into similar direction, will do some clean up of my patch and lets see if we can merge both changes. I really like the idea of the compactionIdGenerator to keep track of individual compactions and it makes easier to abort (or pause) specific compactions in my current implementation I already have the client code and the ACL code and also the extensions for pbuf. > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Fix For: 1.1.0 > > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266835#comment-14266835 ] Manukranth Kolloju commented on HBASE-12446: This is the diff for the task : https://reviews.facebook.net/D30993 > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Fix For: 1.1.0 > > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245585#comment-14245585 ] Esteban Gutierrez commented on HBASE-12446: --- Yeah, I'm working on HBASE-6028, my prototype handles only the case to cancel all compactions in progress for now, but I think we can move it as sub task to handle the shell commands that expose this functionality. Does it sounds good for you [~manukranthk]? > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Fix For: 1.0.0 > > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245572#comment-14245572 ] stack commented on HBASE-12446: --- [~esteban] FYI > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Fix For: 1.0.0 > > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
