[ANNOUNCE] Apache HBase 2.6.1 is now available for download

2024-10-19 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 2.6.1. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn mor

Re: Inquiry on Tentative Release Dates for New Patches and Stability Status for HBase 2.6 Branch

2024-09-25 Thread Nick Dimiduk
Hi Mohammad, Apologies for my tardy reply -- I don't actively monitor the user list. We are working now on the 2.6.1 release. You can track progress on this Jira, https://issues.apache.org/jira/browse/HBASE-28847. Thanks, Nick On Fri, Sep 13, 2024 at 7:21 AM Mohammad Adnan Shaikh wrote: > Hel

Re: [ANNOUNCE] New HBase committer Hui Ruan(阮辉)

2023-09-19 Thread Nick Dimiduk
Congratulations Hui Ruan and thanks a lot for all your contributions ! On Fri, Sep 15, 2023 at 11:08 AM 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Hui > Ruan(frostruan) > has accepted the PMC's invitation to become a committer on the > project. We app

[ANNOUNCE] New HBase committer Nihal Jain

2023-05-03 Thread Nick Dimiduk
Hello! On behalf of the Apache HBase PMC, I am pleased to announce that Nihal Jain has accepted the PMC's invitation to become a committer on the project. We appreciate all of Nihal's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Nihal

Fwd: TAC supporting Berlin Buzzwords

2023-03-28 Thread Nick Dimiduk
FYI -- Forwarded message - From: Gavin McDonald Date: Fri, Mar 24, 2023 at 10:57 Subject: TAC supporting Berlin Buzzwords To: PMCs, Please forward to your dev and user lists. Hi All, The ASF Travel Assistance Committee is supporting taking up to six (6) people to attend Berl

[ANNOUNCE] Apache HBase 2.5.0 is now available for download

2022-09-05 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 2.5.0. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn mor

Re: [ANNOUNCE] Please welcome Xiaolin Ha(哈晓琳) to the HBase PMC

2022-04-13 Thread Nick Dimiduk
Congratulations Xiaolin, we really appreciate your commitment to the project and look forward to further collaboration. Thanks, Nick On Sat, Apr 9, 2022 at 09:11 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Xiaolin Ha > has accepted our invitation to be

Re: [ANNOUNCE] New HBase committer Bryan Beaudreault

2022-04-11 Thread Nick Dimiduk
Thank you Bryan for all your efforts, we appreciate you and your contributions to the project. Congratulations indeed! Thanks, Nick On Sat, Apr 9, 2022 at 04:45 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Bryan > Beaudreault(bbeaudreault) has accepted

Re: [ANNOUNCE] New HBase committer Lei Cheng(程磊)

2022-03-04 Thread Nick Dimiduk
Congratulations Lei, and thank you for all your contributions! On Wed, Mar 2, 2022 at 8:49 AM 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Lei > Cheng(comnetwork) has accepted the PMC's invitation to become a committer > on the project. We appreciate al

Re: [ANNOUNCE] New HBase committer Yutong Xiao(肖禹同)

2022-03-04 Thread Nick Dimiduk
Congratulations Yutong, and thank you for all your contributions! On Wed, Mar 2, 2022 at 8:50 AM 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Yutong > Xiao(YutSean) has accepted the PMC's invitation to become a committer on > the project. We appreciate

[ANNOUNCE] Apache HBase 2.3.7 is now available for download

2021-10-25 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 2.3.7. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn mo

Re: [ANNOUNCE] New HBase committer Zhuoyue Huang(GeorryHuang)

2021-10-14 Thread Nick Dimiduk
Thank you for your contributions, Zhuoyue, and congratulations! On Thu, Oct 14, 2021 at 12:14 AM Guanghao Zhang wrote: > Folks, > > On behalf of the Apache HBase PMC I am pleased to announce that Zhuoyue > Huang has accepted the PMC's invitation to become a committer on the > project. > > We app

Re: [DISCUSS] About using masters as ConnectionRegistry endpoint

2021-08-18 Thread Nick Dimiduk
I recall that there was a concern about data freshness, that the masters were all tracking the necessary state and all of them would always be up-to-date. Region servers were not already in this business, and doing so would put undue burden on ZooKeeper. Perhaps I miss-remember, or the discussion

Re: [ANNOUNCE] New HBase PMC Bharath Vissapragada

2021-08-02 Thread Nick Dimiduk
Congratulations Bharath and thank you for all the effort you put into the project! On Fri, Jul 30, 2021 at 6:27 AM Viraj Jasani wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Bharath > Vissapragada has accepted our invitation to become a PMC member on the > HBase projec

[ANNOUNCE] New HBase committer Baiqiang Zhao

2021-07-10 Thread Nick Dimiduk
Hi everyone, On behalf of the Apache HBase PMC I am pleased to announce that Baiqiang Zhao has accepted the PMC's invitation to become a committer on the project! We appreciate all of the great contributions Baiqiang has made to the community thus far and we look forward to his continued involvem

Re: [ANNOUNCE] New HBase Committer Xiaolin Ha(哈晓琳)

2021-05-17 Thread Nick Dimiduk
Congratulations, Xiaolin, and thank you for all your contributions!! On Sat, May 15, 2021 at 7:11 AM 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Xiaolin > Ha(sunhelly) has accepted the PMC's invitation to become a committer on the > project. We appreci

Re: Multi-dimensional Range Queries Help

2021-05-04 Thread Nick Dimiduk
Hi Kevin, Did you get an answer to your question, maybe over on hbase-user? As it seems you're aware, HBase is built on a single index -- the rowkey. You may be able to implement something like MySQL's composite indexing on HBase if the algorithm can be mapped to a 1-dimensional linear index. You

Re: [ANNOUNCE] New HBase PMC Huaxiang Sun

2021-04-13 Thread Nick Dimiduk
Congratulations, Huaxiang, and thank you for all you do! On Tue, Apr 13, 2021 at 12:39 AM Viraj Jasani wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Huaxiang > Sun has accepted our invitation to become a PMC member on the HBase > project. We appreciate Huaxiang steppin

Re: [DISCUSS] The breaking changes in HBASE-24966

2020-12-11 Thread Nick Dimiduk
On Tue, Dec 1, 2020 at 6:45 AM 张铎(Duo Zhang) wrote: > > If no other objections tomorrow, will follow what Sean proposed above, to > include the patch in 3.0.0 and mark the issue as incompatible change. Belated +1. > 张铎(Duo Zhang) 于2020年11月30日周一 上午11:04写道: > > > I think it could introduce compil

Re: [ANNOUNCE] New HBase committer Xin Sun

2020-12-04 Thread Nick Dimiduk
Congratulations and thank you for your contributions! On Thu, Dec 3, 2020 at 01:13 Guanghao Zhang wrote: > Folks, > > On behalf of the Apache HBase PMC I am pleased to announce that Xin Sun has > accepted the PMC's invitation to become a committer on the project. > > We appreciate all of the gre

Re: [ANNOUNCE] New HBase committer Yulin Niu

2020-12-04 Thread Nick Dimiduk
Congratulations and thank you for your contributions! On Thu, Dec 3, 2020 at 01:11 Guanghao Zhang wrote: > Folks, > > On behalf of the Apache HBase PMC I am pleased to announce that Yulin Niu > has accepted the PMC's invitation to become a committer on the project. > > We appreciate all of the g

Re: [ANNOUNCE] Apache HBase 2.3.2 is now available for download

2020-09-28 Thread Nick Dimiduk
Thank you Viraj for running this release! On Sun, Sep 27, 2020 at 12:29 AM Viraj Jasani wrote: > The HBase team is happy to announce the immediate availability of HBase > 2.3.2. > > Apache HBase™ is an open-source, distributed, versioned, non-relational > database. > Apache HBase gives you low l

[ANNOUNCE] Apache HBase 2.3.1 is now available for download

2020-08-21 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 2.3.1. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn mor

[ANNOUNCE] Apache HBase 2.3.0 is now available for download

2020-07-15 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 2.3.0. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn mor

Re: [DISCUSS] Normalizer and pre-split tables

2020-06-29 Thread Nick Dimiduk
ut > > > awkward special-case checks. > > > > > > > HBASE-23562 added a RegionsMerger tool to hbase-operators-tools project, > > as a mean to allow multiple merges without checking minimum size. Of > course > > it's not as convenient as normalizer

[DISCUSS] Normalizer and pre-split tables

2020-06-26 Thread Nick Dimiduk
Heya, I've seen a lot of use-cases where the normalizer would be a nice solution for operators and application developers. I've been trying to beef it up a bit to handle these cases. However, some of these considerations are at odds, so I want to vet the ideas here. The normalizer is a background

Re: [DISCUSS] Removing problematic terms from our project

2020-06-25 Thread Nick Dimiduk
> > > > > It might be good to have a source of truth web page or README file for > > > developers and users to refer to regarding all naming transitions. It's > > > going to help both developers changing the code and users looking for > > some > >

Re: [DISCUSS] Removing problematic terms from our project

2020-06-24 Thread Nick Dimiduk
On Tue, Jun 23, 2020 at 13:11 Sean Busbey wrote: > I would like to make sure I am emphatically clear that "master" by itself > is not okay if the context is the same as what would normally be a > master/slave context. Furthermore our use of master is clearly such a > context. I agree: to me “Ma

Re: [DISCUSS] Removing problematic terms from our project

2020-06-22 Thread Nick Dimiduk
>From my perspective, we gain nothing as a project or as a community be willfully retaining use of language that is well understood to be problematic or hurtful, even if that terminology has precedent in the technology domain. On the contrary, we have much to gain by encouraging contributions from

Re: DISCUSS: Move hbase-thrift and hbase-rest out of core to hbase-connectors project?

2020-04-27 Thread Nick Dimiduk
On Fri, Apr 24, 2020 at 22:06 Sean Busbey wrote: > By "works with it" do you mean has documented steps to work with it or do > you mean that the convenience binary that ships for 2.3.0 will have the > same deployment model as prior 2.y releases where I can run those services > directly from the d

Re: [DISCUSS] Bump hadoop versions on up coming 2.3.0 and 3.0.0 releases

2020-03-13 Thread Nick Dimiduk
> For me, I prefer we just bump the hadoop version of 2.3.0 directly to 2.10.0, as 2.9.x is almost dead too. For 2.3, I raised this question earlier on "[DISCUSS] Hadoop dependency versions for 2.3" [0]. Our conclusion was "if it ain't broke, don't fix it." Since we've had no previous communicati

Re: Running HBase on Hadoop 3.1, was Re: [ANNOUNCE] Apache HBase 2.1.9 is now available for download

2020-02-21 Thread Nick Dimiduk
ss.com > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for

Running HBase on Hadoop 3.1, was Re: [ANNOUNCE] Apache HBase 2.1.9 is now available for download

2020-02-20 Thread Nick Dimiduk
changed subject, dropped dev Hello Mich, The HBase binary distribution includes all Hadoop client jars necessary for HBase to function on top of HDFS. The version of those Hadoop jars is that of Hadoop 2.8.5. Duo is saying that the Hadoop 2.8.5 client works against a HDFS 3.1.x cluster. Thus, thi

[ANNOUNCE] New HBase committer Bharath Vissapragada

2020-02-05 Thread Nick Dimiduk
On behalf of the Apache HBase PMC I am pleased to announce that Bharath Vissapragada has accepted the PMC's invitation to become a commiter on the project. We appreciate all of Bharath's generous contributions thus far and look forward to his continued involvement. Allow me to be the first to cong

Re: [DISCUSS] Bump hadoop versions

2020-01-03 Thread Nick Dimiduk
On Wed, Dec 25, 2019 at 5:38 PM 张铎(Duo Zhang) wrote: > We will only remove the hadoop 2.x support from hbase 3.x, which does not > have a formal release plan yet, for 2.x we will still support hadoop 2.x. > Indeed there is no formal release plan for HBase-3.0, but I hope it's sooner than 2+ year

Re: Configuration recommendations for EC2 deployment of Apache HBase

2019-03-08 Thread Nick Dimiduk
n > Server > Maximum Session timeout > 60 > same change on zookeeper as well. > > > To increase regionserver heap size for outofmemoryerror etc: > HBase> Configuration > Resource Management > Java Heap Size of HBase > RegionServer in Bytes > > On Mon, Mar 4,

Configuration recommendations for EC2 deployment of Apache HBase

2019-03-04 Thread Nick Dimiduk
Heya, I'm wondering if anyone has published any recent experiences of running Apache HBase (not EMR, not MapR) on EC2. Specifically, I'm looking for configuration tweaks necessary for HBase (1.0+), HDFS (2.7+), Zookeeper (3.4+). Maybe you know of specific talks or blog posts? Thanks a lot, Nick

EOL HBase 1.1

2017-12-14 Thread Nick Dimiduk
Hello, This is for folks who haven't followed our discussions and aren't reading closely the ANNOUNCE mail. The release line from branch-1.1 is now concluded. 1.1.13 was the final release for that line. 1.2 has been our stable release line for quite some time -- please upgrade! Thank you again to

[ANNOUNCE] Apache HBase 1.1.13 is now available for download

2017-12-13 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.13! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase

[ANNOUNCE] Apache HBase 1.1.12 is now available for download

2017-08-22 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.12! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase

Re: [ANNOUNCE] Devaraj Das joins the Apache HBase PMC

2017-07-05 Thread Nick Dimiduk
Congratulations Devaraj! On Wed, Jul 5, 2017 at 9:27 AM, Josh Elser wrote: > I'm pleased to announce yet another PMC addition in the form of Devaraj > Das. One of the "old guard" in the broader Hadoop umbrella, he's also a > long-standing member in our community. We all look forward to the conti

[ANNOUNCE] Apache HBase 1.1.11 is now available for download

2017-06-21 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.11! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase

[ANNOUNCE] Apache HBase 1.1.10 is now available for download

2017-04-30 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.10! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase

Re: ANNOUNCE: Yu Li joins the Apache HBase PMC

2017-04-15 Thread Nick Dimiduk
Congratulations Yu and thanks a lot! Keep up the good work! On Fri, Apr 14, 2017 at 7:22 AM Anoop John wrote: > On behalf of the Apache HBase PMC I"m pleased to announce that Yu Li > has accepted our invitation to become a PMC member on the Apache HBase > project. He has been an active contribut

Re: [ANNOUNCE] - Welcome our new HBase committer Anastasia Braginsky

2017-03-28 Thread Nick Dimiduk
Thank you for all your contributions Anastasia! On Mon, Mar 27, 2017 at 5:38 AM ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Hi All > > Welcome Anastasia Braginsky, one more female committer to HBase. She has > been active now for a while with her Compacting memstore feature

[ANNOUNCE] Apache HBase 1.1.9 is now available for download

2017-02-28 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.9! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.9 is the ninth patch release in the HBase 1.1 line, continuing on the theme of bringi

Re: [ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread Nick Dimiduk
Congratulations Guanghao and thank you for all your contributions! On Mon, Dec 19, 2016 at 5:37 PM Duo Zhang wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao > > Zhang has accepted the PMC's invitation to become a committer on the > > project. We appreciate all

[ANNOUNCE] Apache HBase 1.1.8 is now available for download

2016-12-19 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.8! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.8 is the eighth patch release in the HBase 1.1 line, continuing on the theme of bring

[ANNOUNCE] New HBase Committer Josh Elser

2016-12-10 Thread Nick Dimiduk
On behalf of the Apache HBase PMC, I am pleased to announce that Josh Elser has accepted the PMC's invitation to become a committer on the project. We appreciate all of Josh's generous contributions thus far and look forward to his continued involvement. Allow me to be the first to congratulate an

Re: Verification of Short Circuit Reads

2016-11-14 Thread Nick Dimiduk
arches out of curiosity which state that unix filesystem > permissions should be sufficient (the hbase user would not need to be in > the hdfs group). > > Is the permission on /var/run/hadoop-hdfs set correctly? (hbase user could > do that same `ls`) > > > Nick Dimiduk wrote: &g

Re: [DISCUSS] EOL 1.1 Release Branch

2016-11-08 Thread Nick Dimiduk
You're right Enis, sounds like we'll continue on with 1.1. No issues on my side, I'm happy to continue producing these releases as I'm able. Thanks everyone for the discussion. On Monday, November 7, 2016, Enis Söztutar wrote: > Going back to the original discussion, the conclusion is to contin

Re: Verification of Short Circuit Reads

2016-11-04 Thread Nick Dimiduk
That closing question should have been "so I add the _hbase_ user to the hdfs group?" On Thursday, November 3, 2016, Nick Dimiduk wrote: > Hello there, > > I'm setting up a new cluster and I notice in my RS startup logs an ominous > warning. > > 2016-11-03 21:5

[DISCUSS] EOL 1.1 Release Branch

2016-11-04 Thread Nick Dimiduk
Hello HBase Community! We have a small matter to discuss. HBase 1.2 has been formally marked as "stable" for the last couple months. HBase 1.3.0rc0 is just around the corner. I think it's time to start a conversation about retiring the 1.1 line. The volunteer bandwidth for maintaining multiple br

Verification of Short Circuit Reads

2016-11-03 Thread Nick Dimiduk
Hello there, I'm setting up a new cluster and I notice in my RS startup logs an ominous warning. 2016-11-03 21:52:14,624 WARN [RS_LOG_REPLAY_OPS-r103u3:16020-0] shortcircuit.DomainSocketFactory: error creating DomainSocket java.net.ConnectException: connect(2) error: Permission denied when tryin

Re: [ANNOUNCE] Stephen Yuan Jiang joins Apache HBase PMC

2016-10-24 Thread Nick Dimiduk
Congratulations Steven and thank you for the continued effort! On Friday, October 14, 2016, Enis Söztutar wrote: > On behalf of the Apache HBase PMC, I am happy to announce that Stephen has > accepted our invitation to become a PMC member of the Apache HBase project. > > Stephen has been working

Re: [ANNOUNCE] Duo Zhang (张铎) joins the Apache HBase PMC

2016-09-07 Thread Nick Dimiduk
Thank you Duo, and congratulations! On Tue, Sep 6, 2016 at 9:26 PM, Stack wrote: > On behalf of the Apache HBase PMC I am pleased to announce that 张铎 > has accepted our invitation to become a PMC member on the Apache > HBase project. Duo has healthy notions on where the project should be > heade

[ANNOUNCE] Apache HBase 1.1.6 is now available for download

2016-09-07 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.6! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.6 is the sixth patch release in the HBase 1.1 line, continuing on the theme of bringi

Re: [ANNOUNCE] Dima Spivak joins the Apache HBase PMC

2016-08-31 Thread Nick Dimiduk
Congratulations Dima, and thank you! On Wed, Aug 31, 2016 at 12:37 PM, Andrew Purtell wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Dima Spivak > has accepted our invitation to become a committer and PMC member on the > Apache HBase project. Dima has been an active con

Re: [DISCUSS] 0.98 branch disposition

2016-08-31 Thread Nick Dimiduk
0.98 has had a great run! I think it's entirely reasonable to start winding it down. Maybe some blog post walking through the upgrade process -- demonstrating how easy it is and where the gotchas may lie would help encourage our brave and true 23%. Thank you for your dedicated and diligent 2.5 yea

Re: [ANNOUNCE] Mikhail Antonov joins the Apache HBase PMC

2016-05-27 Thread Nick Dimiduk
Nice work Mikhail! Congrats. On Thu, May 26, 2016 at 11:30 AM, Andrew Purtell wrote: > On behalf of the Apache HBase PMC I am pleased to announce that Mikhail > Antonov has accepted our invitation to become a PMC member on the Apache > HBase project. Mikhail has been an active contributor in man

[ANNOUNCE] Apache HBase 1.1.5 is now available for download

2016-05-14 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.5! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.5 is the fifth patch release in the HBase 1.1 line, continuing on the theme of bringi

Re: Retiring empty regions

2016-04-26 Thread Nick Dimiduk
re will be a presentation on time-series HBase (hbasecon.com) > Come > join us :) > > > On Mon, Apr 4, 2016 at 8:34 AM, Nick Dimiduk wrote: > > > > Crazy idea, but you might be able to take stripped down version of > region > > > normalizer code and

Re: Retiring empty regions

2016-04-20 Thread Nick Dimiduk
ur distribution and our book? -n [0]: https://phoenix.apache.org/rowtimestamp.html On Mon, Apr 4, 2016 at 8:34 AM, Nick Dimiduk wrote: > > Crazy idea, but you might be able to take stripped down version of > region > > normalizer code and make a Tool to run? Requesting split or mer

Re: Retiring empty regions

2016-04-04 Thread Nick Dimiduk
> > > > > "Short of upgrading to 1.2 for the region normalizer," > > > > > > A bit off topic, but I think unfortunately region normalizer now > ignores > > > empty regions to avoid undoing pre-split on the table. This is > something > >

Retiring empty regions

2016-03-31 Thread Nick Dimiduk
Hi folks, I have a table with TTL enabled. It's been receiving data for a while beyond the TTL and I now have a number of empty regions. I'd like to drop those empty regions to free up heap space on the region servers and reduce master load. I'm running a 1.1 derivative. The only threads I found

[ANNOUNCE] Apache HBase 1.1.4 is now available for download

2016-03-27 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.4! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.4 is the fourth patch release in the HBase 1.1 line, continuing on the theme of bring

Re: Deadlock in WALProcedureStore

2016-02-23 Thread Nick Dimiduk
Thanks for confirming. On Tue, Feb 23, 2016 at 1:58 PM, Matteo Bertozzi wrote: > yeah same as HBASE-14947, the 2nd lock on the store tracker is gone with > that change > > Matteo > > > On Tue, Feb 23, 2016 at 1:50 PM, Nick Dimiduk wrote: > > > Heya, > > >

Deadlock in WALProcedureStore

2016-02-23 Thread Nick Dimiduk
Heya, I ran into a deadlock today (create table via phoenix) and I'm wondering if its the same as HBASE-14947 or if this is a new issue. This is in 1.1.2. Thanks, Nick Found one Java-level deadlock: = "WALProcedureStoreSyncThread": waiting to lock monitor 0x7fd4

Re: HDFS short-circuit tokens expiring

2016-02-12 Thread Nick Dimiduk
else like it in mind. > > --Chris Nauroth > > From: Dejan Menges mailto:dejan.men...@gmail.com>> > Date: Wednesday, January 20, 2016 at 3:26 AM > To: Nick Dimiduk mailto:ndimi...@apache.org>>, " > u...@hadoop.apache.org<mailto:u...@hadoop.apache.org>&q

[ANNOUNCE] Apache HBase 1.1.3 is now available for download

2016-01-27 Thread Nick Dimiduk
The HBase team is happy to announce the immediate availability of HBase 1.1.3! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.3 is the third patch release in the HBase 1.1 line, continuing on the theme of bringi

HDFS short-circuit tokens expiring

2016-01-19 Thread Nick Dimiduk
Hi folks, This looks like it sits in the intersection between HDFS and HBase. My region server logs are flooding with messages like "SecretManager$InvalidToken: access control error while attempting to set up short-circuit access to ... is expired" [0]. These logs correspond with responseTooSlow

Re: Opinions wanted: new site skin

2015-10-28 Thread Nick Dimiduk
Nice work Misty. For me, the first link [0] looks a lot better than the second link [1]. I'm with Andrew in that if we're not prepared to actively receive PR's from github, we should remove the banner. Do you have your patch for [0], you can send my way and I'll tweak it to remove the banner. As

Re: Introducing Project S2Graph

2015-10-07 Thread Nick Dimiduk
Very cool, thanks for posting Doyung Yoon! On Wed, Oct 7, 2015 at 10:57 AM, DO YUNG YOON wrote: > Hello Forks. > > I want to introduce an open-source distributed graph database s2graph on > HBase. > > Here is the github repository and presentations that describe how s2graph > store data as prope

Re: hbase.bucketcache.percentage.in.combinedcache with ioengine= on HBase 0.98

2015-10-07 Thread Nick Dimiduk
kporting if all else fails... > > Would also bigger great if anyone had any insight in the differences > between offheap and file:/ in terms of configuration. When RAM to tmpfs was > used as the workaround for the RS issue, was MaxDirectMemory size still > set? > > Thanks! > On

Re: hbase.bucketcache.percentage.in.combinedcache with ioengine= on HBase 0.98

2015-10-06 Thread Nick Dimiduk
Configuring offheap cache in 0.98 is a huge PITA. There are some example configs [0] linked from my old blog post [1], maybe that's a starting point? I also worked with our docs team to get this explained [2] in a somewhat useful way, using an algorithm/formula as the basis of the explanation. That

Re: Hadoop streaming with HBase as data sink

2015-10-06 Thread Nick Dimiduk
Maybe run more thrift gateways? Maybe one on each host running map tasks and have the tasks talk to localhost. That way your job doesn't bottleneck through a single thrift server. > Solar Cell Data Management sounds cool. +1 :) On Fri, Oct 2, 2015 at 1:19 PM, Stack wrote: > On Fri, Oct 2, 2015

Re: Thinking of HBase 1.1.3 [was HBASE-14317 and 1.1.3]

2015-09-29 Thread Nick Dimiduk
releases. Ugly, but we can rethrow as RuntimeException or ignore in 1.1 and > before. > > I think this is also a blocker: > https://issues.apache.org/jira/browse/HBASE-14474 > > Enis > > On Wed, Sep 23, 2015 at 3:50 PM, Nick Dimiduk wrote: > >> I&#x

Re: Thinking of HBase 1.1.3 [was HBASE-14317 and 1.1.3]

2015-09-23 Thread Nick Dimiduk
2_compat_report.html [2]: http://hbase.apache.org/book.html#hbase.versioning [3]: https://issues.apache.org/jira/browse/HBASE-14394?focusedCommentId=14905429&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14905429 On Mon, Sep 21, 2015 at 3:18 PM, Nick Dimiduk wrot

Thinking of HBase 1.1.3 [was HBASE-14317 and 1.1.3]

2015-09-21 Thread Nick Dimiduk
#x27;s? > > Yes, absolutely, and if you'd also like help making the RCs mail me > privately. > > On Fri, Sep 4, 2015 at 8:11 AM, Nick Dimiduk wrote: > > > Hi folks, > > > > I know we just got through voting periods on three patch releases, but > > HBA

Re: hbase thrift connection drops / refuses after warning

2015-09-18 Thread Nick Dimiduk
The thrift deamon just stalls? You don't see this on 0.98.6 -- do you ever see retries exhausted exceptions on 0.98? On Wed, Sep 2, 2015 at 5:17 PM, Abraham Tom wrote: > Trying to see if anybody knows why this is happening and how to fix > we are on hbase 1.1.1 > > We use javascript to connect t

HBASE-14317 and 1.1.3

2015-09-04 Thread Nick Dimiduk
Hi folks, I know we just got through voting periods on three patch releases, but HBASE-14317 is looking pretty bad by my eye. Given we have a fix on our end, I'm up for spinning 1.1.3 a couple weeks early. How does the community feel about it? Users: do you need this patch immediately? PMC: do you

[ANNOUNCE] Apache HBase 1.1.2 is now available for download

2015-09-02 Thread Nick Dimiduk
The HBase team is happy to announce the availability of HBase 1.1.2! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.lua/hbase/, or wire up through the maven repo. HBase 1.1.2 is the second patch release in the HBase 1.1 line, continuing on the theme of bringing a stab

Re: Which version of branch-1 to pick up for product environment

2015-08-25 Thread Nick Dimiduk
Unless you've observed some serious issue preventing you from doing so, I would suggest adopting the newest release available. If you're a particularly conservative lot, perhaps choose one previous. The 0.98 and branch-1 releases are all rolling-upgradable between them, so upgrading production shou

Re: Please welcome new HBase committer Stephen Yuan Jiang

2015-08-21 Thread Nick Dimiduk
Nice work Stephen! On Thu, Aug 20, 2015 at 7:09 PM, Andrew Purtell wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Stephen > Jiang has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Stephen's hard work and generous > contribut

Re: In Windows, cannot capture HBase prompt('hbase(main):001:0>') from neither standard output nor standard error using process API

2015-08-13 Thread Nick Dimiduk
dev to bcc Hi Dinesh, I'm not sure what you mean by "process API". Are you launching the hbase shell as an external process? Would be better to use an HBase client. We have a nice one in Java. We also have REST and Thrift gateways, which are launched as separate processes. There's also Apache Pho

Request for help: shaded client jars (HBASE-13889)

2015-08-10 Thread Nick Dimiduk
Heya, One of our "advertised features" on 1.1 is a shaded packaging of client jars. Initial patches went through but it seems the feature is not standing up to more thorough testing. A number of users have expressed interest in this packaging, and there are some better test applications for verify

Re: ApacheCON EU HBase Track Submissions

2015-06-30 Thread Nick Dimiduk
Get your submissions in, the deadline is imminent! On Thu, Jun 25, 2015 at 11:29 AM, Nick Dimiduk wrote: > Hello developers, users, speakers, > > As part of ApacheCON's inaugural "Apache: Big Data", I'm hoping to see an > HBase-centric "HBase: NoSQL + SQL

[ANNOUNCE] HBase 1.1.1 is now available for download

2015-06-30 Thread Nick Dimiduk
The HBase team is happy to announce the availability of HBase 1.1.1! Download it from an Apache mirror near you, http://www.apache.org/dyn/closer.cgi/hbase/, or wire up through the maven repo. HBase 1.1.1 is the first patch release in the HBase 1.1 line, continuing on the theme of bringing a stabl

[RESULT][VOTE] First release candidate for HBase 1.1.1 (RC0) is available

2015-06-29 Thread Nick Dimiduk
The vote has passed with 3 binding +1's. J-M's concerns regarding test stability are well noted; hopefully we'll be more impressive in future releases. Thanks for testing the release. Nick On Tue, Jun 23, 2015 at 4:25 PM, Nick Dimiduk wrote: > I'm happy to announce the

Re: 2 bucket caches?

2015-06-29 Thread Nick Dimiduk
Hi J-M, N-leveled caching is something I've discussed with some folks but it hasn't been done. We already have multi-cache management strategies, such as CombinedBlockCache, so this would be making them more generic and exposing through configuration. Something you'd be interested in taking on? D

Re: [VOTE] First release candidate for HBase 1.1.1 (RC0) is available

2015-06-28 Thread Nick Dimiduk
Just a reminder, there's roughly 6 hours left in the voting cycle. Realistically a few more than that, as I won't observe results until AM/Pacific time on Monday. Thanks for your time and attention, -n On Tue, Jun 23, 2015 at 4:25 PM, Nick Dimiduk wrote: > I'm happy to

Re: ApacheCON EU HBase Track Submissions

2015-06-26 Thread Nick Dimiduk
given the opportunity to organize tracks for the big data conference. On Thu, Jun 25, 2015 at 11:29 AM, Nick Dimiduk > wrote: > > > Hello developers, users, speakers, > > > > As part of ApacheCON's inaugural "Apache: Big Data", I'm hoping to see an > >

ApacheCON EU HBase Track Submissions

2015-06-25 Thread Nick Dimiduk
Hello developers, users, speakers, As part of ApacheCON's inaugural "Apache: Big Data", I'm hoping to see an HBase-centric "HBase: NoSQL + SQL" track come together. The idea is to showcase the growing ecosystem of applications and tools built on top of and around Apache HBase. To have a track, we

Re: [VOTE] First release candidate for HBase 1.1.1 (RC0) is available

2015-06-25 Thread Nick Dimiduk
On Thu, Jun 25, 2015 at 4:23 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Also, any idea why non of the tests pass on my side? > I tried some of them individually and they passed: > --- > T E S T S > --

Re: [VOTE] First release candidate for HBase 1.1.1 (RC0) is available

2015-06-24 Thread Nick Dimiduk
[0]: http://people.apache.org/~ndimiduk/1.1.0_1.1.1RC0_compat_report.html On Tue, Jun 23, 2015 at 4:25 PM, Nick Dimiduk wrote: > I'm happy to announce the first release candidate of HBase 1.1.1 > (HBase-1.1.1RC0) is available for download at > https://dist.apache.org/repos/dist/dev/hbase/h

[VOTE] First release candidate for HBase 1.1.1 (RC0) is available

2015-06-23 Thread Nick Dimiduk
I'm happy to announce the first release candidate of HBase 1.1.1 (HBase-1.1.1RC0) is available for download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.1RC0/ Maven artifacts are also available in the staging repository https://repository.apache.org/content/repositories/orgapachehbase

Re: Stochastic Balancer by tables

2015-06-19 Thread Nick Dimiduk
what > > > > you've described - centralized periodic analysis of region sizes and > > > > equalization as needed (somewhat complementary to balancing), and any > > > > feedback (especially from folks experiencing real issues with unequal > > > > regi

Re: Stochastic Balancer by tables

2015-06-18 Thread Nick Dimiduk
If you're interested in region size balancing, please have a look at https://issues.apache.org/jira/browse/HBASE-13103 . Please provide feedback as we're hoping to have an early version available in 1.2. Which reminds me, I owe Mikhail another review... On Thu, Jun 18, 2015 at 9:39 AM, Elliott Cl

Re: Connections and scalability

2015-06-12 Thread Nick Dimiduk
Hi Joseph, Sorry no one as spoken up yet. I don't know the details in this area off the top of my head, but i'd suggest having a look at the gateways (REST, Thrift) to see how they handle authenticated users. My guess is they are keeping a connection per user, but I've not looked at the code rece

Re: Monitor off heap Bucket Cache

2015-06-01 Thread Nick Dimiduk
Also note that configuration is slightly changed between 0.98 and 1.0, see HBASE-11520. From the release note: > Remove "hbase.bucketcache.percentage.in.combinedcache". Simplifies config of block cache. If you are using this config., after > this patch goes in, it will be ignored. The L1 LruBlockC

  1   2   3   4   >