Hi,
We wrote something similar. It just triggers major compaction with given
parallelism and distribute it across the cluster.
https://github.com/flipkart-incubator/hbase-compactor
On Dec 16, 2017 10:01 AM, "Jean-Marc Spaggiari"
wrote:
Rahul,
I had something in mind for months/years! It's a
Rahul,
I had something in mind for months/years! It's a must to have! Thanks for
taking the task! I like register to the JIRA and come back very soon with
tons of ides and recommendations. You can count on my to test it too!
JMS
2017-12-15 17:44 GMT-05:00 rahul gidwani :
> The tool creates a Ma
The tool creates a Map of servers to CompactionRequests needing to be
performed. You always select the server with the largest queue (*which is
not currently compacting) *to compact next.
I created a JIRA: HBASE-19528 for this tool.
On Fri, Dec 15, 2017 at 2:35 PM, Ted Yu wrote:
> bq. with at
Appy created HBASE-19530:
Summary: New regions should always be added with state CLOSED
Key: HBASE-19530
URL: https://issues.apache.org/jira/browse/HBASE-19530
Project: HBase
Issue Type: Bug
Appy created HBASE-19529:
Summary: Handle null states in AM
Key: HBASE-19529
URL: https://issues.apache.org/jira/browse/HBASE-19529
Project: HBase
Issue Type: Bug
Reporter: Appy
>From d
bq. with at most N distinct RegionServers compacting at a given time
If per table balancing is not on, the regions for the underlying table may
not be evenly distributed across the cluster.
In that case, how would the tool which servers to perform compaction ?
I think you can log a JIRA for upstr
churro morales created HBASE-19528:
--
Summary: Major Compaction Tool
Key: HBASE-19528
URL: https://issues.apache.org/jira/browse/HBASE-19528
Project: HBase
Issue Type: New Feature
Hi Rahul,
That sounds like a very useful tool. It would be a good extension to the
pedagogy I point folks to for scheduled HBase major compactions via Oozie
(which just does a naive asynchronous table-wide major compaction today):
https://github.com/cbaenziger/Oozie_MajorCompaction_Example
-Cl
Hi,
I was wondering if anyone was interested in a manual major compactor tool.
The basic overview of how this tool works is:
Parameters:
-
Table
-
Stores
-
ClusterConcurrency
-
Timestamp
So you input a table, desired concurrency and the list of stores you wish
to m
stack created HBASE-19527:
-
Summary: Make ExecutorService threads daemon=true.
Key: HBASE-19527
URL: https://issues.apache.org/jira/browse/HBASE-19527
Project: HBase
Issue Type: Bug
Repor
[
https://issues.apache.org/jira/browse/HBASE-19272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack resolved HBASE-19272.
---
Resolution: Fixed
Assignee: stack
I pushed .001 to branch-2 and master. It just removes the named tests
Mike Drob created HBASE-19526:
-
Summary: Update hadoop version to 3.0 GA
Key: HBASE-19526
URL: https://issues.apache.org/jira/browse/HBASE-19526
Project: HBase
Issue Type: Task
Componen
Thanks Nick for your cool curation of our branch-1.
Nice job done,
S
On Thu, Dec 14, 2017 at 10:25 AM, Nick Dimiduk wrote:
> Hello,
>
> This is for folks who haven't followed our discussions and aren't reading
> closely the ANNOUNCE mail. The release line from branch-1.1 is now
> concluded. 1.1.
[
https://issues.apache.org/jira/browse/HBASE-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack resolved HBASE-18110.
---
Resolution: Fixed
Resolving as done. Accounting of all tests disabled has them all onlined again
unless expl
Duo Zhang created HBASE-19525:
-
Summary: RS side changes for moving peer modication from zk
watcher to procedure
Key: HBASE-19525
URL: https://issues.apache.org/jira/browse/HBASE-19525
Project: HBase
Duo Zhang created HBASE-19524:
-
Summary: Master side changes for moving peer modification from zk
watcher to procedure
Key: HBASE-19524
URL: https://issues.apache.org/jira/browse/HBASE-19524
Project: HBas
[
https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang resolved HBASE-14790.
---
Resolution: Fixed
More than two years, finally we are done!
Thanks all who helping on this new featu
Duo Zhang created HBASE-19523:
-
Summary: TestLogRolling is flakey
Key: HBASE-19523
URL: https://issues.apache.org/jira/browse/HBASE-19523
Project: HBase
Issue Type: Bug
Components: test
Guanghao Zhang created HBASE-19522:
--
Summary: The complete order is wrong in AsyncBufferedMutatorImpl
Key: HBASE-19522
URL: https://issues.apache.org/jira/browse/HBASE-19522
Project: HBase
I
Thanks for all the great work as branch-1.1 RM sir, it's definitely a
successful release line!
Best Regards,
Yu
On 15 December 2017 at 02:25, Nick Dimiduk wrote:
> Hello,
>
> This is for folks who haven't followed our discussions and aren't reading
> closely the ANNOUNCE mail. The release line
20 matches
Mail list logo
