Re: [VOTE] Merge space quota branch (HBASE-16961) into master
I won't pretend to be involved enough in the 2.0 work to give an opinion :) -- I did say earlier that I'm happy to land this in 2.0 or 3.0 (whatever master decides to be at the time I merge). If the spirit of the voters is to include this in 3.0 and not 2.0, that's fine by me. I'm also happy to not immediately merge after this vote completes. Andrew Purtell wrote: Would it help to cut a branch for 2.0 before attempting to merge in a new major feature? On Tue, May 9, 2017 at 8:41 AM, Josh Elser wrote: Reminder: I hope to close this in ~30hrs and there have been no votes so far. Josh Elser wrote: Folks, This is a vote to (rebase and) merge the branch HBASE-16961 into master. Per the book, this requires 3 binding +1's from other committers to merge. Relevant info for those who want to revisit any topics: DISCUSS on merge[1] Design Doc[2] Staged user manual[3] I'll plan to leave this open for at least 72hrs of the work days (Wednesday May 10th EOD) in case there are any vetos. I would prefer to abstain from voting on my own feature and plan to do so if the votes are otherwise lacking. - Josh [1] https://lists.apache.org/thread.html/a28c69bff315a791b9f7b94 6636446a60bd2ddc8d5a9f5c11c2bf6f4@%3Cdev.hbase.apache.org%3E [2] http://home.apache.org/~elserj/hbase/FileSystemQuotasforApac heHBase.pdf [3] https://people.apache.org/~elserj/hbase/quotas/book.html#space-quotas
[jira] [Created] (HBASE-18021) Add more info in timed out RetriesExhaustedException for read replica client get processing,
huaxiang sun created HBASE-18021: Summary: Add more info in timed out RetriesExhaustedException for read replica client get processing, Key: HBASE-18021 URL: https://issues.apache.org/jira/browse/HBASE-18021 Project: HBase Issue Type: Improvement Components: Client Affects Versions: 2.0.0 Reporter: huaxiang sun Assignee: huaxiang sun Priority: Minor Right now, when the client does not receive results from replica servers within configured timeout period, the client does not print out info which helps to understand/identify the cause. Please see https://github.com/apache/hbase/blob/master/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java#L212 More info needs to be filled in the exception so it helps to pinpoint the root cause quickly. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: [VOTE] Merge space quota branch (HBASE-16961) into master
Would it help to cut a branch for 2.0 before attempting to merge in a new major feature? On Tue, May 9, 2017 at 8:41 AM, Josh Elser wrote: > Reminder: I hope to close this in ~30hrs and there have been no votes so > far. > > > Josh Elser wrote: > >> Folks, >> >> This is a vote to (rebase and) merge the branch HBASE-16961 into master. >> Per the book, this requires 3 binding +1's from other committers to merge. >> >> Relevant info for those who want to revisit any topics: >> >> DISCUSS on merge[1] >> Design Doc[2] >> Staged user manual[3] >> >> I'll plan to leave this open for at least 72hrs of the work days >> (Wednesday May 10th EOD) in case there are any vetos. I would prefer to >> abstain from voting on my own feature and plan to do so if the votes are >> otherwise lacking. >> >> - Josh >> >> [1] >> https://lists.apache.org/thread.html/a28c69bff315a791b9f7b94 >> 6636446a60bd2ddc8d5a9f5c11c2bf6f4@%3Cdev.hbase.apache.org%3E >> >> [2] http://home.apache.org/~elserj/hbase/FileSystemQuotasforApac >> heHBase.pdf >> [3] https://people.apache.org/~elserj/hbase/quotas/book.html#space-quotas >> > -- Best regards, - Andy If you are given a choice, you believe you have acted freely. - Raymond Teller (via Peter Watts)
[jira] [Created] (HBASE-18020) Update API Compliance Checker to Incorporate Improvements Done in Hadoop
Alex Leblang created HBASE-18020: Summary: Update API Compliance Checker to Incorporate Improvements Done in Hadoop Key: HBASE-18020 URL: https://issues.apache.org/jira/browse/HBASE-18020 Project: HBase Issue Type: Improvement Components: API, community Reporter: Alex Leblang Recently the Hadoop community has made a number of improvements in their api compliance checker based on feedback from the hbase and kudu community. We should adopt these changes ourselves. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (HBASE-18019) Clear redundant memstore scanner
Chia-Ping Tsai created HBASE-18019:
--
Summary: Clear redundant memstore scanner
Key: HBASE-18019
URL: https://issues.apache.org/jira/browse/HBASE-18019
Project: HBase
Issue Type: Improvement
Affects Versions: 2.0.0
Reporter: Chia-Ping Tsai
Assignee: Chia-Ping Tsai
Fix For: 2.0.0
The HBASE-17655 remove the MemStoreScanner and it causes that the
MemStore#getScanner(readpt) returns multi KeyValueScanner which consist of
active, snapshot and pipeline. But StoreScanner only remove one mem scanner
when refreshing current scanners.
{code}
for (int i = 0; i < currentScanners.size(); i++) {
if (!currentScanners.get(i).isFileScanner()) {
currentScanners.remove(i);
break;
}
}
{code}
The older scanners kept in the StoreScanner will hinder GC from releasing
memory and lead to multiple scans on the same data.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (HBASE-18018) Support abort for all procedures by default
Umesh Agashe created HBASE-18018: Summary: Support abort for all procedures by default Key: HBASE-18018 URL: https://issues.apache.org/jira/browse/HBASE-18018 Project: HBase Issue Type: Sub-task Components: proc-v2 Reporter: Umesh Agashe Assignee: Umesh Agashe Changes the default behavior of StateMachineProcedure to support aborting all procedures even if rollback is not supported. On abort, procedure is treated as failed and rollback is called but for procedures which cannot be rolled back abort is ignored currently. This sometime causes procedure to get stuck in waiting state forever. User should have an option to abort any stuck procedure and clean up manually. Please refer to HBASE-18016 and discussion there. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: [VOTE] Merge space quota branch (HBASE-16961) into master
+1 on merging this to master branch. I have reviewed Josh's work for phase 1. This is an important addition for multi-tenant deployments. On Fri, May 5, 2017 at 4:24 PM, Josh Elser wrote: > Folks, > > This is a vote to (rebase and) merge the branch HBASE-16961 into master. > Per the book, this requires 3 binding +1's from other committers to merge. > > Relevant info for those who want to revisit any topics: > > DISCUSS on merge[1] > Design Doc[2] > Staged user manual[3] > > I'll plan to leave this open for at least 72hrs of the work days > (Wednesday May 10th EOD) in case there are any vetos. I would prefer to > abstain from voting on my own feature and plan to do so if the votes are > otherwise lacking. > > - Josh > > [1] https://lists.apache.org/thread.html/a28c69bff315a791b9f7b94 > 6636446a60bd2ddc8d5a9f5c11c2bf6f4@%3Cdev.hbase.apache.org%3E > [2] http://home.apache.org/~elserj/hbase/FileSystemQuotasforApac > heHBase.pdf > [3] https://people.apache.org/~elserj/hbase/quotas/book.html#space-quotas >
Re: [VOTE] Merge space quota branch (HBASE-16961) into master
Reminder: I hope to close this in ~30hrs and there have been no votes so far. Josh Elser wrote: Folks, This is a vote to (rebase and) merge the branch HBASE-16961 into master. Per the book, this requires 3 binding +1's from other committers to merge. Relevant info for those who want to revisit any topics: DISCUSS on merge[1] Design Doc[2] Staged user manual[3] I'll plan to leave this open for at least 72hrs of the work days (Wednesday May 10th EOD) in case there are any vetos. I would prefer to abstain from voting on my own feature and plan to do so if the votes are otherwise lacking. - Josh [1] https://lists.apache.org/thread.html/a28c69bff315a791b9f7b946636446a60bd2ddc8d5a9f5c11c2bf6f4@%3Cdev.hbase.apache.org%3E [2] http://home.apache.org/~elserj/hbase/FileSystemQuotasforApacheHBase.pdf [3] https://people.apache.org/~elserj/hbase/quotas/book.html#space-quotas
[jira] [Resolved] (HBASE-17999) Pyspark HBase Connector
[ https://issues.apache.org/jira/browse/HBASE-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser resolved HBASE-17999. Resolution: Invalid Please ask questions on the user mailing list: u...@hbase.apache.org > Pyspark HBase Connector > --- > > Key: HBASE-17999 > URL: https://issues.apache.org/jira/browse/HBASE-17999 > Project: HBase > Issue Type: Brainstorming > Components: API >Affects Versions: 1.2.4 > Environment: Centos7, Python >Reporter: Waqar Muhammad > > Is there a way/connector to connect hbase from pyspark and perform queries? > Is there any official documentation for that? Would be awsome if someone > could point me in the right direction > Thanks in advance -- This message was sent by Atlassian JIRA (v6.3.15#6346)
