Re: Recovering hbase after a failure

2014-10-02 Thread Andrew Purtell
​On Thu, Oct 2, 2014 at 11:17 AM, Buckley,Ron wrote: > Also, once the original /hbase got mv'd, a few of the region servers did > some flush's before they aborted. Those RS's actually created a new > /hbase, with new table directories, but only containing the data from the > flush. Sounds lik

Re: protobuf error

2014-10-01 Thread Andrew Purtell
are linked via openvpn rather than normal networking. So its > possiblt that openvpn is doing something to the packets that is affecting > this. > > -Ian > > On Wednesday 01 October 2014 09:12:05 Andrew Purtell wrote: >> Thanks for reporting this. Please see >> http

Re: protobuf error

2014-10-01 Thread Andrew Purtell
Thanks for reporting this. Please see https://issues.apache.org/jira/browse/HBASE-12141. Hope I've understood the issue correctly. We will look into it. On Wed, Oct 1, 2014 at 4:37 AM, Ian Brooks wrote: > Hi, > > I have a java client that connects to hbase and reads and writes data to > hbase.

Re: hbase row locking

2014-09-28 Thread Andrew Purtell
> When HDFS gets tiered storage, we can revive this and put HBase's WAL on SSD > storage. I think the archival storage work just committed (and ported into branch-2?) might be sufficient for a pilot of HBASE-6572. A few important changes were filed late, like APIs for apps for setting policy an

Re: Hbase-Testing-Util jar files are empty (except meta-inf and dirs) on maven central repo?

2014-09-27 Thread Andrew Purtell
hbase-testing-util doesn't include code. It's a meta module used to collect dependencies. Attach sources from hbase-server instead for the HBaseTestingUtility class. > On Sep 27, 2014, at 4:53 PM, Stephen Boesch wrote: > > I am trying to manually attach the sources for the HBaseTestingUtil t

Re: Thrift-vs-Thrift2

2014-09-20 Thread Andrew Purtell
ree it needs to be completed. I know > I have been tardy on this and need to speed up. :( Darn work always comes > in between. > > On Thu, Sep 18, 2014 at 11:48 PM, Andrew Purtell > wrote: > >> Survey: Is anyone using the Thrift 2 interface? >> >> Not here

Re: Performance oddity between AWS instance sizes

2014-09-19 Thread Andrew Purtell
FWIW, I pushed a fix for that NPE On Fri, Sep 19, 2014 at 9:13 AM, Andrew Purtell wrote: > Thanks for trying the new client out. Shame about that NPE, I'll look into it. > > > >> On Sep 18, 2014, at 8:43 PM, Josh Williams wrote: >> >> Hi Andrew, >&g

Re: Performance oddity between AWS instance sizes

2014-09-19 Thread Andrew Purtell
times I ran it, it'll hit a NullPointerException[1] ... but it > definitely seems to point more at a problem in the older YCSB. > > [1] https://gist.github.com/joshwilliams/0570a3095ad6417ca74f > > Thanks for your help, > > -- Josh > > >> On Thu, 2014-09-18 at 15

Re: Performance oddity between AWS instance sizes

2014-09-18 Thread Andrew Purtell
1 GB heap is nowhere enough to run if you're tying to test something real (or approximate it with YCSB). Try 4 or 8, anything up to 31 GB, use case dependent. >= 32 GB gives away compressed OOPs and maybe GC issues. Also, I recently redid the HBase YCSB client in a modern way for >= 0.98. See http

Re: Thrift-vs-Thrift2

2014-09-18 Thread Andrew Purtell
Survey: Is anyone using the Thrift 2 interface? Not here. On Thu, Sep 18, 2014 at 2:24 PM, Stack wrote: > On Thu, Sep 18, 2014 at 3:56 AM, Kiran Kumar.M.R > wrote: > >> Hi, >> Our customers were using Hbase-0.94 through thrift1 (C++ clients). >> Now HBase is getting upgraded to 0.98.x >> >> I s

[ANNOUNCE] HBase 0.98.6.1 is now available for download

2014-09-18 Thread Andrew Purtell
Apache HBase 0.98.6.1 is a patch release for 0.98.6 fixing a regression in 0.98.6 involving non-superuser table creation when security is active (HBASE-11972). Please use this release instead of 0.98.6. (We have removed 0.98.6 distribution artifacts in the mirrors.) Get 0.98.6.1 from an Apache mirr

Re: [ANNOUNCE] HBase 0.98.6 is now available for download

2014-09-18 Thread Andrew Purtell
tro wrote: > Did this release make it to maven central? I can't seem to find it. > > On Wed, Sep 10, 2014 at 4:50 PM, Andrew Purtell wrote: > >> Apache HBase 0.98.6 is now available for download. Get it from an >> Apache mirror [1] or Maven repository. >>

Re: Adding 64-bit nodes to 32-bit cluster?

2014-09-15 Thread Andrew Purtell
On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari wrote: > Do we have kind of native compression in PB? Protobufs has its own encodings, the Java language bindings implement them in Java. -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (

Re: Adding 64-bit nodes to 32-bit cluster?

2014-09-15 Thread Andrew Purtell
Only where we touch the native Hadoop libraries I think. If you have specified compression implemented with a Hadoop native library, like snappy or lzo, and have forgotten to deploy 64 bit native libraries, and move to this 64 bit environment, you won't be able to open the affected table(s) until n

[ANNOUNCE] HBase 0.98.6 is now available for download

2014-09-10 Thread Andrew Purtell
Apache HBase 0.98.6 is now available for download. Get it from an Apache mirror [1] or Maven repository. The list of changes in this release can be found in the release notes [2] or following this announcement. Thanks to all who contributed to this release. Best, The HBase Dev Team 1. http://w

Re: Connecting Hbase to Elasticsearch with Phoenix

2014-09-10 Thread Andrew Purtell
Thanks for writing in with this pointer Alex! On Wed, Sep 10, 2014 at 11:11 AM, Alex Kamil wrote: > I posted step-by-step instructions here on using Apache Hbase/Phoenix with > Elasticsearch JDBC River. > > This might be useful to Elasticsearch users who want to use Hbase as a > primary data stor

Re: HBase Reference Guide for previous releases

2014-09-10 Thread Andrew Purtell
0.98 is very similar to trunk and 0.96 is retired. It hasn't made sense to make a differentiated guide for 0.98. The trunk version applies just about everywhere. Where there is a difference in 0.98 it is mentioned in the relevant section of the guide. On Wed, Sep 10, 2014 at 2:06 PM, Jerry He wro

Re: HBase - Performance issue

2014-09-08 Thread Andrew Purtell
What about providing the jstack as Lars suggested? That doesn't require you to upgrade (yet) 0.94.23 is the same major version as 0.94.1. Upgrading to this version is not the same process as a major upgrade from 0.92 to 0.94. Changes like the split policy difference you mention don't happen in poi

Re: state-of-the-art method for merging regions on v0.94

2014-08-28 Thread Andrew Purtell
If the 0.94 merge code doesn't work out the box we should fix that. On Thu, Aug 28, 2014 at 11:26 AM, Bryan Beaudreault < bbeaudrea...@hubspot.com> wrote: > I've done it. This is the code I used: > https://gist.github.com/bbeaudreault/7567385 > > It comes from the hbase source, but is modified

Re: Compilation error: HBASE 0.98.4 with Snappy

2014-08-26 Thread Andrew Purtell
On Tue, Aug 26, 2014 at 4:25 PM, arthur.hk.c...@gmail.com < arthur.hk.c...@gmail.com> wrote: > Exception in thread "main" java.lang.RuntimeException: native snappy > library not available: this version of libhadoop was built without snappy > support. ​ You are almost there. Unfortunately the nati

Re: single RegionServer stuck, causing cluster to hang

2014-08-23 Thread Andrew Purtell
On Sat, Aug 23, 2014 at 12:11 PM, Johannes Schaback < johannes.schab...@visual-meta.com> wrote: > Exception in thread "defaultRpcServer.handler=5,queue=2,port=60020" > java.lang.StackOverflowError > at org.apache.hadoop.hbase.CellUtil$1.advance(CellUtil.java:210) > at org.apache.ha

Re: hbase is not deleting the cell when a Put with a KeyValue, KeyValue.Type.Delete is submitted

2014-08-21 Thread Andrew Purtell
See also the latest comment on the JIRA. :-) On Thu, Aug 21, 2014 at 1:13 PM, ​​ Srikanth Srungarapu wrote: > Hi, > Did you try taking a look at > > https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/RowMutations.html > ? > > Thanks, > Srikanth. > > > On Thu, Aug 21, 2014 at 1:03 P

Re: GC peaks during major compaction

2014-08-21 Thread Andrew Purtell
G1 is not the default collector for Java 7. You have to enable it specifically with -XX:+UseG1GC I believe the default collector for the server VM in 7 (and 8) is the parallel collector, equivalent to specifying -XX:+UseParallelGC. Yes, you need to not select more than one collector on the JVM co

Re: GC peaks during major compaction

2014-08-20 Thread Andrew Purtell
Cool, let me ping my former colleagues about that. On Wed, Aug 20, 2014 at 11:34 AM, Bryan Beaudreault < bbeaudrea...@hubspot.com> wrote: > That blog post is awesome, I hadn't seen it before. Eagerly looking > forward to parts 2 and 3. > > > > > On Wed, Aug 20,

Re: GC peaks during major compaction

2014-08-20 Thread Andrew Purtell
If using Java 7 and G1, you might want to look over: https://software.intel.com/en-us/blogs/2014/06/18/part-1-tuning-java-garbage-collection-for-hbase On Wed, Aug 20, 2014 at 8:26 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > I agree with Bryan. > > HBase start to have some GC diff

Re: Shout-out for Misty

2014-08-20 Thread Andrew Purtell
Huge +1 On Tue, Aug 19, 2014 at 10:53 PM, Nick Dimiduk wrote: > Our docs are getting a lot of love lately, courtesy of one Misty > Stanley-Jones. As someone who joined this community by way of > documentation, I'd like to say: Thank you, Misty! > > -n > -- Best regards, - Andy Problems

Re: HBase latest stable version

2014-08-13 Thread Andrew Purtell
The latest stable version of HBase is 0.98.5. ​​ The upgrade procedure for 0.94 -> 0.96 can be applied in the exact same manner to 0.94 -> 0.98. There is no need to upgrade through 0.96 as an intermediate step. ​​ We discussed this recently and I expect we are going to stop supporting (as a communi

[ANNOUNCE] HBase 0.98.5 is now available for download

2014-08-13 Thread Andrew Purtell
​​ Apache HBase 0.98.5 is now available for download. Get it from an Apache mirror [1] or Maven repository. ​​ The list of changes in this release can be found in the release notes [2] or following this announcement. ​​ Thanks to all who contributed to this release. ​​ Best, ​​ The HBase Dev Te

Re: hbase restful interface...

2014-08-13 Thread Andrew Purtell
Another resource is the Javadoc for the rest server package: http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/rest/package-summary.html On Wed, Aug 13, 2014 at 10:07 AM, Esteban Gutierrez wrote: > Hello Sean, > > Have you looked into the HBase wiki page for the REST server? > http://wiki

Re: [VOTE] The 1st HBase 0.98.5 release candidate (RC0) is available, vote closing 8/11/2014

2014-08-12 Thread Andrew Purtell
: > +1 binding > > Checked signing. > Checked rat > Checked tar layout > Ran locally > performed some snapshots. > > > On Mon, Aug 11, 2014 at 10:53 AM, Andrew Purtell > wrote: > > > Thanks. I just committed HBASE-11716 for release in 0.98.6 at the end of &g

Re: How to checkout source code of specific version of hbase.

2014-08-11 Thread Andrew Purtell
For the first/initial patch, a diff against master attached to the issue would be fine. If the changes are reviewed and are acceptable, then you and we would look at back porting the changes to other branches, at which point in time helping us out with branch specific patches could be helpful. ​

Re: [VOTE] The 1st HBase 0.98.5 release candidate (RC0) is available, vote closing 8/11/2014

2014-08-11 Thread Andrew Purtell
gt; > LoadTestDataGeneratorWithVisibilityLabels. > > > As it is an issue only with IT test and no code level issues, you can > > take > > > a call Andy.I have raised HBASE-11716 and attached a simple patch. > > > > > > -Anoop- > &

Re: Stargate perf and troubleshooting tips

2014-08-11 Thread Andrew Purtell
st be specified. > maxversions - To limit the number of versions of each column to be > returned. > batchsize - To limit the maximum number of values returned for each call > to next(). > limit - The number of rows to return in the scan operation. > > > > > > > 发自

Re: [VOTE] The 1st HBase 0.98.5 release candidate (RC0) is available, vote closing 8/11/2014

2014-08-10 Thread Andrew Purtell
d -hadoop2 bin tar ball > > - checked contents, documentation, checksums, etc > > - inserted some data, checked with raw-scans, flushed, compacted, > inserted > > again, checked again. All good. > > - downloaded source tarball, checked contents, CHANGES.txt, etc. >

Re: flush table with AES encryption enabled for CF, randomly wrapException observed

2014-08-08 Thread Andrew Purtell
Trying out the at rest encryption feature ​is very much appreciated, but perhaps we can spend a bit more time excluding other issues before declaring an encryption bug. So far there hasn't been one (knock on wood!) but a cursory search of user@hbase might imply the feature is buggy. On Fri, Aug 8

Re: Stargate perf and troubleshooting tips

2014-08-07 Thread Andrew Purtell
On Wed, Aug 6, 2014 at 11:20 PM, SiMaYunRui wrote: > Further investigation showsthat if I repeatedly fetch data very quick, the > latter scanner creations are very fast (< 100ms), but if there is >1minute > interval between two data fetching, the latter is slow. > ​ > I am certain that it’s not c

Re: hbase attack scenarios?

2014-08-06 Thread Andrew Purtell
We have no known vulnerabilities that equate to a SQL injection attack vulnerability. However, as Esteban says you'd want to treat HBase like any other datastore underpinning a production service and out of an abundance of caution deploy it into a secure enclave behind an internal service API, so r

[VOTE] The 1st HBase 0.98.5 release candidate (RC0) is available, vote closing 8/11/2014

2014-08-05 Thread Andrew Purtell
​The 1st HBase 0.98.​5 release candidate (RC0) is available for download ​at http://people.apache.org/~apurtell/0.98.5RC0/ and Maven artifacts are also available in the temporary repository ​ https://repository.apache.org/content/repositories/orgapachehbase-1027/ Signed with my code signing key D5

Re: Problem reading HFile Trailer by using HFile tool

2014-08-01 Thread Andrew Purtell
You have a problem with your environment: Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util. NativeCodeLoader.buildSupportsSnappy()Z Fix your native Hadoop libraries, or don't use Snappy. This is not related to encryption. On Fri, Aug 1, 2014 at 7:12 AM, Shankar hiremath < shan

Re: HBase file encryption, inconsistencies observed and data loss

2014-07-30 Thread Andrew Purtell
Let's take this to JIRA On Wed, Jul 30, 2014 at 12:50 PM, Ted Yu wrote: > In BaseDecoder#rethrowEofException() : > > if (!isEof) throw ioEx; > > LOG.error("Partial cell read caused by EOF: " + ioEx); > > EOFException eofEx = new EOFException("Partial cell read"); > > eofEx.initC

Re: HBase file encryption, inconsistencies observed and data loss

2014-07-28 Thread Andrew Purtell
all existing wals are replayed) > > And files moved to old logs but not corrupt folder is something tobe > checked. Any chance for a look there and patch Shankar? > > Anoop > > > Anoop > > > > >> On Sunday, July 27, 2014, Andrew Purtell wrote: >

Re: HBase file encryption, inconsistencies observed and data loss

2014-07-27 Thread Andrew Purtell
under corrupt logs is > a concerning thing. Need to look at that. > > -Anoop- > > On Sat, Jul 26, 2014 at 11:17 PM, Andrew Purtell > wrote: > >> ​​My attempt to reproduce this issue: >> >> 1. Set up Hadoop 2.4.1 namenode, secondarynamenode, and datanode

Re: HBase file encryption, inconsistencies observed and data loss

2014-07-26 Thread Andrew Purtell
, 2014 at 8:54 AM, Andrew Purtell wrote: > Thanks for the detail. So to summarize: > > 0. HBase 0.98.3 and HDFS 2.4.1 > > 1. All data before failure has not yet been flushed so only exists in the > WAL files. > > 2. During distributed splitting, the WAL has either not

Re: HBase file encryption, inconsistencies observed and data loss

2014-07-26 Thread Andrew Purtell
> > hbase.regionserver.wal.encryption > false > > > > Regards > -Shankar > > This e-mail and its attachments contain confidential information from HUAWEI, > which is intended only for the person or entity whose address is listed > above. Any u

Re: HBase file encryption, inconsistencies observed and data loss

2014-07-25 Thread Andrew Purtell
Encryption (or the lack of it) doesn't explain missing HFiles. Most likely if you are having a problem with encryption, this will manifest as follows: HFiles will be present. However, you will find many IOExceptions in the regionserver logs as they attempt to open the HFiles but fail because the d

Re: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Andrew Purtell
After trying Esteban's suggestion, please also generate a listing using 'lsof -nP' to turn off hostname and port name resolution. No idea here what those port numbers "busboy" or "eforward" map to. Important to determine if those are HBase or HDFS service ports. On Thu, Jul 24, 2014 at 11:00 AM,

[ANNOUNCE] HBase 0.98.4 is now available for download

2014-07-22 Thread Andrew Purtell
Apache HBase 0.98.4 is now available for download. Get it from an Apache mirror [1] or Maven repository. The list of changes in this release can be found in the release notes [2] or following this announcement. Thanks to all who contributed to this release. Best, The HBase Dev Team 1. http://w

Re: WALPlayer kills many RS when play large number of WALs

2014-07-22 Thread Andrew Purtell
to fix the Java Heap space error for mapreduce job, they are > recommended to increase the mapred.child.java.opts to higher. > > http://stackoverflow.com/questions/8464048/out-of-memory-error-in-hadoop > > Thanks > Tian-Ying > > > > > > On Tue, Jul 22, 2014 at 9:1

Re: WALPlayer kills many RS when play large number of WALs

2014-07-22 Thread Andrew Purtell
n you need to take steps to reduce resource consumption. Limit the allowed number of concurrent mapreduce tasks. Reduce the heap size specified in 'mapred.child.java.opts'. Or both. ​ On Tue, Jul 22, 2014 at 9:12 AM, Andrew Purtell wrote: > You need to better manage the colocatio

Re: WALPlayer kills many RS when play large number of WALs

2014-07-22 Thread Andrew Purtell
You need to better manage the colocation of the mapreduce runtime. In other words, you are allowing mapreduce to grab too many node resources, resulting in activation of the kernel's OOM killer. A good rule of thumb is the aggregate of all Java heaps (daemons like DataNOde, RegionServer, NodeManage

Re: [VOTE] The 1st HBase 0.98.4 release candidate (RC0) is available, vote closing 7/21/2014

2014-07-22 Thread Andrew Purtell
With 6 +1 votes and no -1 or 0 votes, the vote carries and RC0 will be released as 0.98.4. I'll send the release announcement out shortly. Thanks to all who tested the RC! On Mon, Jul 14, 2014 at 8:38 PM, Andrew Purtell wrote: > The 1st HBase 0.98.4 release candidate (RC0) is avail

Re: ANNOUNCE: Tephra for HBase transactions

2014-07-21 Thread Andrew Purtell
Awesome! Please consider adding a pointer to Tephra to the HBase wiki's supporting projects page: http://wiki.apache.org/hadoop/SupportingProjects On Sat, Jul 19, 2014 at 12:46 AM, Gary Helmling wrote: > Hi all, > > I would like to introduce a new open source project, Continuuity Tephra, > whi

Re: Cluster sizing guidelines

2014-07-19 Thread Andrew Purtell
your earlier one. > > > > > > From: Amandeep Khurana > To: "user@hbase.apache.org" > Sent: Thursday, July 17, 2014 11:36 AM > Subject: Re: Cluster sizing guidelines > > >> On Wed, Jul 16, 2014 at 2:32 PM, Andrew

Re: [VOTE] The 1st HBase 0.98.4 release candidate (RC0) is available, vote closing 7/21/2014

2014-07-17 Thread Andrew Purtell
ll need to change my vote back to +1 because I can't veto a RC for something I can't verify. On Thu, Jul 17, 2014 at 5:51 PM, Andrew Purtell wrote: > Bisecting now. > > I plan to find and revert the culprit and any related commits, confirm > improvement with workload E, push

Re: [VOTE] The 1st HBase 0.98.4 release candidate (RC0) is available, vote closing 7/21/2014

2014-07-17 Thread Andrew Purtell
issue). On Thu, Jul 17, 2014 at 5:12 PM, Andrew Purtell wrote: > See thread on dev@ titled "Comparing the performance of 0.98.4 RC0 and > 0.98.0 using YCSB - 23% perf regression in workload E" > > -1 on this RC for now, pending reproduction and further analysis on a dev >

Re: [VOTE] The 1st HBase 0.98.4 release candidate (RC0) is available, vote closing 7/21/2014

2014-07-17 Thread Andrew Purtell
7136 [SCAN]99thPercentileLatency(ms)169 187 On Mon, Jul 14, 2014 at 8:38 PM, Andrew Purtell wrote: > The 1st HBase 0.98.4 release candidate (RC0) is available for download at > http://people.apache.org/~apurtell/0.98.4RC0/ and Maven artifacts are > also available in the temporary

Re: Cluster sizing guidelines

2014-07-17 Thread Andrew Purtell
:32 PM, Andrew Purtell > wrote: > > > Those questions don't have pat answers. HBase has a few interesting load > > dependent tunables and the ceiling you'll encounter depends as much on > the > > characteristics of the nodes (particularly, block devices) and th

Re: Cluster sizing guidelines

2014-07-16 Thread Andrew Purtell
Those questions don't have pat answers. HBase has a few interesting load dependent tunables and the ceiling you'll encounter depends as much on the characteristics of the nodes (particularly, block devices) and the network, not merely the software. We can certainly, through experimentation, establ

[VOTE] The 1st HBase 0.98.4 release candidate (RC0) is available, vote closing 7/21/2014

2014-07-14 Thread Andrew Purtell
The 1st HBase 0.98.4 release candidate (RC0) is available for download at http://people.apache.org/~apurtell/0.98.4RC0/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1026/ Signed with my code signing key D5365CC

Re: Question about HFile indices

2014-07-14 Thread Andrew Purtell
We used to hold the entire HFile index in memory, although you could trade off between the size of the index and amount of IO required to find the desired records. Facebook found the aggregate size of indexes far too large for their use case(s) so included the tiered index in the HFile V2 redesign.

Re: How Hbase achieves efficient random access?

2014-07-07 Thread Andrew Purtell
at 12:56 PM, Andrew Purtell wrote: > > Out of curiosity Vladimir, did you feel like a fork of HBase was necessary > because of something about the Apache HBase project's process or community? > Or was it more of a licensing thing (noting you're not using ASL 2)? > >

Re: How Hbase achieves efficient random access?

2014-07-07 Thread Andrew Purtell
Out of curiosity Vladimir, did you feel like a fork of HBase was necessary because of something about the Apache HBase project's process or community? Or was it more of a licensing thing (noting you're not using ASL 2)? On Jul 6, 2014, at 11:26 PM, Vladimir Rodionov wrote: >>> >>> Another is

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-27 Thread Andrew Purtell
Giuseppe mentioned a contributing factor is HDP ups the cache size from 256 to 4096. On Fri, Jun 27, 2014 at 2:31 PM, lars hofhansl wrote: > Sounds scary! > HDP 2.1 ships with Hadoop 2.4.0, right? > > > Sounds like a serious HDFS bug with SSR. > Maybe we need to at least document this behavior

Fwd: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Andrew Purtell
Forwarded -- Forwarded message -- From: Vladimir Rodionov Date: Wed, Jun 25, 2014 at 12:03 PM Subject: RE: Disk space leak when using HBase and HDFS ShortCircuit To: "user@hbase.apache.org" >> Apparently those file descriptors were stored by the HDFS >> ShortCircuit cache. As

Re: HBase 0.94.3 with ACL RS won't start

2014-06-20 Thread Andrew Purtell
Have you set up keytabs for the server processes? On Thu, Jun 19, 2014 at 9:40 PM, Demai Ni wrote: > hi, folks, > > I am able to recreate the same error on another single node cluster. > > RS log pasted here: http://pastebin.com/iP9Mrz2T > and > hbase-site.xml is here: http://pastebin.com/ppnqf

Re: HFile V2 vs HFile V3

2014-06-13 Thread Andrew Purtell
If you read down through that JIRA, you'll have the answer to that question: The results were inconclusive and the changes in that patch broke thread safety. I also suggest returning to the bottom of the Cassandra wiki page you mentioned and follow the link to the JIRA. Cassandra appears to have n

Re: Introducing Project Trafodion

2014-06-11 Thread Andrew Purtell
Congratulations, and thank you for making an OLTP option for HBase available in open source. On Wed, Jun 11, 2014 at 2:57 PM, Birdsall, Dave wrote: > Hi, > > The cat is already out of the bag on Trafodion on this dlist (and we are > very happy about it actually). But, here's an official announc

[ANNOUNCE] HBase 0.98.3 is now available for download

2014-06-09 Thread Andrew Purtell
Apache HBase 0.98.3 is now available for download. Get it at your nearest Apache mirror [1] or Maven repository. The list of changes in this release can be found in the release notes [2] or following this announcement. Thanks to all who contributed to this release. Best, The HBase Dev Team 1.

Re: 答复: 答复: 答复: forcing flush not works

2014-06-06 Thread Andrew Purtell
The requested URL */D2N6ZDvk,http://paste2.org/a64LXD0X * was not found on this server. The link you followed is probably outdated. On Fri, Jun 6, 2014 at 6:33 PM, sunweiwei wrote: > Hi > > The symptom reproduced again. > I paste the log in http://paste2.org/D2N6Z

Re: 答复: 答复: 答复: forcing flush not works

2014-06-06 Thread Andrew Purtell
Bah, mis-paste and send with the same clipboard action, please ignore. On Fri, Jun 6, 2014 at 6:35 PM, Andrew Purtell wrote: > The requested URL */D2N6ZDvk,http://paste2.org/a64LXD0X > <http://paste2.org/a64LXD0X>* was not found on this server. The link you > followed is pr

Re: [VOTE] The 3nd HBase 0.98.3 release candidate (RC2) is available, vote closing 6/7/2014

2014-06-02 Thread Andrew Purtell
.3-hadoop2 stack$ gpg --verify > hbase-0.98.3-src.tar.gz.asc hbase-0.98.3-src.tar.gz > gpg: Signature made Sat May 31 23:05:47 2014 PDT using RSA key ID D5365CCD > gpg: Good signature from "Andrew Purtell (CODE SIGNING KEY) < > apurt...@apache.org>" > gpg: WARNING: This

[VOTE] The 3nd HBase 0.98.3 release candidate (RC2) is available, vote closing 6/7/2014

2014-06-01 Thread Andrew Purtell
The 3rd HBase 0.98.3 release candidate (RC2) is available for download at http://people.apache.org/~apurtell/0.98.3RC2/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1024/ Signed with my code signing key D5365CC

[CANCELLED] [VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-30 Thread Andrew Purtell
committed, and the next one should go quite smoothly. On Mon, May 26, 2014 at 2:18 PM, Andrew Purtell wrote: > The 2nd HBase 0.98.3 release candidate (RC1) is available for download at > http://people.apache.org/~apurtell/0.98.3RC1/ and Maven artifacts are > also available in the

Re: Region Server hung during shutdown after StackOverflow error

2014-05-30 Thread Andrew Purtell
Maybe we can kill the zookeeper connection in the abort handler. On Fri, May 30, 2014 at 9:38 AM, Buckley,Ron wrote: > Thanks Ted. I should have seen that. > > I finally had to 'kill -9' the rs, as I couldnt get it to shut down any > other way. > > It seems like, the Region Server shouldnt have

[VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-26 Thread Andrew Purtell
The 2nd HBase 0.98.3 release candidate (RC1) is available for download at http://people.apache.org/~apurtell/0.98.3RC1/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1022 Signed with my code signing key D5365CCD

[CANCELLED] [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available

2014-05-26 Thread Andrew Purtell
New RC forthcoming -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Andrew Purtell
Then it won't get in. > On May 26, 2014, at 10:18 AM, Ted Yu wrote: > > Matt is traveling. > > He said he would review tonight. > > Cheers > >> On May 26, 2014, at 10:16 AM, Andrew Purtell >> wrote: >> >> Then it may not get in

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Andrew Purtell
gt; HBASE-11253 also can be fixed in next RC. Patch is available in Jira. Pls > review. > > -Anoop- > > On Mon, May 26, 2014 at 11:04 AM, Andrew Purtell wrote: > >> For the record, -1 due to HBASE-11251: Vandana fixed the problem that >> prevented IntegrationTestIngest

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-26 Thread Andrew Purtell
Then it may not get in. > On May 26, 2014, at 3:43 AM, Ted Yu wrote: > > I was waiting for Matt Corgan to take a look at prefix tree changes in the > fix for HBASE-11234. > > FYI > >> On May 25, 2014, at 10:34 PM, Andrew Purtell wrote: >> >>

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-25 Thread Andrew Purtell
so we can have the whole work week available for testing. If you'd like to get 11234 in Ted please commit soon. On Sun, May 25, 2014 at 10:23 PM, Andrew Purtell wrote: > Sure > > > On Sun, May 25, 2014 at 10:15 PM, Ted Yu wrote: > >> Andrew: >> Patch for H

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-25 Thread Andrew Purtell
Sure On Sun, May 25, 2014 at 10:15 PM, Ted Yu wrote: > Andrew: > Patch for HBASE-11234 is ready. > Any chance of including it in the next RC ? > > Cheers > > > On Sun, May 25, 2014 at 10:09 PM, Andrew Purtell > wrote: > > > I will roll a new RC as soon as

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-25 Thread Andrew Purtell
p-1-bin tarball, checked checksums >> - unpacked, checked documentation and contents >> - started in local mode, checked UI pages >> - created some tables, wrote some data >> - flushed, compacted, scanned >> >> All good. Might do some more extensive

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-23 Thread Andrew Purtell
As with all the other 0.98 releases, built on a dev box. > On May 23, 2014, at 9:06 PM, lars hofhansl wrote: > > Did you build this yourself? > Apache jenkins seems to take a holiday. > > -- Lars > > > > ____________ > From: Andrew Purt

[VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

2014-05-23 Thread Andrew Purtell
The 1st HBase 0.98.3 release candidate (RC0) is available for download at http://people.apache.org/~apurtell/0.98.3RC0/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehba

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-12 Thread Andrew Purtell
It's not always fun, but it's important service to > the community. > > > -- Lars > > > > > From: Andrew Purtell > To: "d...@hbase.apache.org" > Cc: "user@hbase.apache.org" > Sent: Sunday, May 11,

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-11 Thread Andrew Purtell
I do accept responsibility that the release vote was not well timed with HBaseCon in the mix, and then the Apache email outage. The decision to resign is still the right one for messing up. On Mon, May 12, 2014 at 10:54 AM, Andrew Purtell wrote: > Actually I do resign as RM for 0.98 effect

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-11 Thread Andrew Purtell
Actually I do resign as RM for 0.98 effective immediately. I've not seen the community before disinterested in a release sufficiently that not even simple package verification is time worth spending. > On May 12, 2014, at 10:47 AM, Andrew Purtell wrote: > > Too late I alrea

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-11 Thread Andrew Purtell
t least > three +1 votes from PMC members[1]. Perhaps people were a bit busy last > week due to HBaseCon and we should extend the voting on this release > candidate for another week? > > [1] http://www.apache.org/foundation/voting.html > > -Todd > > >> On Fri

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-11 Thread Andrew Purtell
On Thu, May 8, 2014 at 12:37 PM, Konstantin Boudnik wrote: > BIGTOP-1302 ​Ouch. See the comment I left on that issue. I could look into that for you if you are amenable.​ -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

[ANNOUNCE] HBase 0.98.2 is now available for download

2014-05-10 Thread Andrew Purtell
Apache HBase 0.98.2 is now available for download. Get it at your nearest Apache mirror [1] or Maven repository. The list of changes in this release can be found in the release notes [2] or following this announcement. Thanks to all who contributed to this release. Best, The HBase Dev Team 1.

Re: Re: Re: Re: taking snapshot's creates to many TCP CLOSE_WAIT handles on the hbase master server

2014-05-10 Thread Andrew Purtell
; > Regards Hansi > > > Gesendet: Mittwoch, 30. April 2014 um 18:48 Uhr > > Von: "Andrew Purtell" > > An: "user@hbase.apache.org" > > Betreff: Re: Re: Re: taking snapshot's creates to many TCP CLOSE_WAIT > handles on the hbase mast

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-10 Thread Andrew Purtell
With one +1 and no 0 or -1 votes, this vote has passed. I have sent the artifacts onward for mirroring and will announce in ~24 hours. On Wed, May 7, 2014 at 10:04 AM, Andrew Purtell wrote: > +1 > > Unit test suite passes 100% 25 times out of 25 runs on Java 6u43, 7u45, > and 8u0.

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-07 Thread Andrew Purtell
g the performance of 0.98.2 RC0 and 0.98.0 using YCSB". On Wed, Apr 30, 2014 at 8:50 PM, Andrew Purtell wrote: > The 1st HBase 0.98.2 release candidate (RC0) is available for download at > http://people.apache.org/~apurtell/0.98.2RC0/ and Maven artifacts are > also availab

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-02 Thread Andrew Purtell
Do your worst! :-) On Friday, May 2, 2014, Konstantin Boudnik wrote: > 0.98.2 (RC0) is getting built smoothly in Bigtop 0.8.0! > > Not to do some testing with it ;) > > Thanks guys! > Cos > > On Wed, Apr 30, 2014 at 08:50PM, Andrew Purtell wrote: > > The 1st

[VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-04-30 Thread Andrew Purtell
The 1st HBase 0.98.2 release candidate (RC0) is available for download at http://people.apache.org/~apurtell/0.98.2RC0/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1020 . Signed with my code signing key D5365C

Re: Re: Re: taking snapshot's creates to many TCP CLOSE_WAIT handles on the hbase master server

2014-04-30 Thread Andrew Purtell
Let's circle back to the original mail: > When I run lsof I saw that there where a lot of TCP CLOSE_WAIT handles open with the regionserver as target. Is that right? *Regionserver*, not another process (datanode or whatever)? Or did I miss where somewhere along this thread there was evidence conf

[ANNOUNCE] HBase 0.98.1 is now available for download

2014-04-06 Thread Andrew Purtell
Apache HBase 0.98.1 is now available for download. Get it at your nearest Apache mirror [1] or Maven repository. The list of changes in this release can be found in the release notes [2] or following this announcement. Thanks to all who contributed to this release. Best, The HBase Dev Team 1.

Re: [VOTE] The 4th HBase 0.98.1 release candidate (RC3) is available for download

2014-04-03 Thread Andrew Purtell
(cc dev@) On Fri, Apr 4, 2014 at 8:29 AM, Andrew Purtell wrote: > Thank you, the release of 0.98.1 will happen on time unless there is a new > development. > > > On Fri, Apr 4, 2014 at 4:23 AM, ramkrishna vasudevan < > ramkrishna.s.vasude...@gmail.com> wrote: > >&

Re: [VOTE] The 4th HBase 0.98.1 release candidate (RC3) is available for download

2014-04-03 Thread Andrew Purtell
so > > it > > > > seems that HBASE-10850 has no impact wrt Phoenix. Can't we get these > > > > additional bugs in 0.98.2 - it's one month away [1]? > > > > > > > > James > > > > > > > > [1] http://en.wikipedia.o

Re: [VOTE] The 4th HBase 0.98.1 release candidate (RC3) is available for download

2014-04-03 Thread Andrew Purtell
t time. >> >> Regards >> Ram >> >> >>> On Thu, Apr 3, 2014 at 3:47 PM, Ted Yu wrote: >>> >>> Understood, Andy. >>> >>> I have integrated fix for HBASE-10850 to 0.98 >>> >>> Cheers >>> >

<    1   2   3   4   5   6   7   8   9   10   >