Re: Pre commit job is broken on H0

2017-04-25 Thread Ted Yu
Infra has taken some action. I manually triggered a QA run which seems to get past git checkout step: https://builds.apache.org/job/PreCommit-HBASE-Build/6559/console FYI On Mon, Apr 24, 2017 at 8:25 AM, Ted Yu wrote: > Logged INFRA-13985 - this problem affects wide ranging precommit j

Re: org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot broken in branch-1?

2017-04-26 Thread Ted Yu
You can take a look at: https://builds.apache.org/job/HBASE-Find-Flaky-Tests/lastSuccessfulBuild/artifact/dashboard.html It seems the test is flaky. FYI On Wed, Apr 26, 2017 at 2:25 PM, Stephen Jiang wrote: > I am running "org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot" > test in my

Re: Time to retire EOM branch releases from dist?

2017-04-30 Thread Ted Yu
+1 On Sun, Apr 30, 2017 at 5:29 PM, Nick Dimiduk wrote: > Heya, > > I noticed we still have hbase-0.94.27 and hbase-1.0.3 syncing out on the > mirrors [0]. Since both of these lines are formally EOM, I think it's time > to retire the bits as well. Of course, people can always grab them from the

Re: Sporadically failing precommit tasks

2017-05-02 Thread Ted Yu
[3] [4] are for master branch. Don't know why branch-1 testing is "special". On Tue, May 2, 2017 at 8:41 AM, Josh Elser wrote: > I've been running into an issue where the PreCommit job fails when > building the Yetus Docker image because it attempts to fetch a version of > Oracle JDK8 (8u121) w

flaky test report

2017-05-05 Thread Ted Yu
Hi, I was looking at https://builds.apache.org/job/HBASE-Find-Flaky-Tests/lastSuccessfulBuild/artifact/dashboard.html When I clicked on some of the run Ids, e.g. https://builds.apache.org/job/HBASE-Flaky-Tests//15564 I got status 404. Does someone know what happened to the builds ? Thanks

Re: flaky test report

2017-05-05 Thread Ted Yu
May 5, 2017 at 3:13 PM, Ted Yu wrote: > > > Hi, > > I was looking at > > https://builds.apache.org/job/HBASE-Find-Flaky-Tests/ > > lastSuccessfulBuild/artifact/dashboard.html > > > > When I clicked on some of the run Ids, e.g. > > > > https://

Re: Query Hbase

2017-05-07 Thread Ted Yu
SingleColumnValueFilter can be used on one column. You can use FilterList to chain multiple SingleColumnValueFilter together. Cheers On Sun, May 7, 2017 at 10:56 AM, Developer Brasil < alfredo.tava...@terra.com.br> wrote: > How do I query multiple columns with filters in hbase? > In sql it would

Re: Query Hbase

2017-05-07 Thread Ted Yu
Thank You > > Could send an example is which of the options and more performative ?? > > > > Em 7 de mai de 2017, às 18:16, Ted Yu-3 [via Apache HBase] < > ml+s679495n408786...@n3.nabble.com> escreveu: > > > > SingleColumnValueFilter can be used on one colu

Re: [VOTE] Merge space quota branch (HBASE-16961) into master

2017-05-09 Thread Ted Yu
+1 on merging this to master branch. I have reviewed Josh's work for phase 1. This is an important addition for multi-tenant deployments. On Fri, May 5, 2017 at 4:24 PM, Josh Elser wrote: > Folks, > > This is a vote to (rebase and) merge the branch HBASE-16961 into master. > Per the book, this

Re: HBASE and MOB

2017-05-15 Thread Ted Yu
we revive HBASE-15370: Backport Moderate Object Storage (MOB) to > > branch-1 ? > > > > Even we have customers using this feature and it requires lots of effort > > to backport MOB patches from master branch to the released versions as > the > > code base has lots o

Re: What is Dead Region Servers and how to clear them up?

2017-05-27 Thread Ted Yu
gt; > > > > > > > -Dima > > > > > > > > On Fri, May 26, 2017 at 9:48 AM, jeff saremi > > > > > wrote: > > > > > > > > > I had posted this to the user mailing list and I have not got any > > > direct > > >

Re: What is Dead Region Servers and how to clear them up?

2017-05-27 Thread Ted Yu
ve 3 yarn jobs one for each of master, region, and thrift servers > each launched separately with different number of nodes. I hope that's not > what is causing problems. > > ________ > From: Ted Yu > Sent: Saturday, May 27, 2017 11:27:36 AM > To: d

Re: Hadoop QA failed to build in branch-1 & branch-1.3

2017-05-31 Thread Ted Yu
Here is the action from hadoop to get around this problem: HADOOP-14474 On Tue, May 30, 2017 at 8:26 PM, OpenInx wrote: > The current problem is: we got 404 not found returned when we install jdk7 > ( Oracle Corp changed the jdk7 download link and need accept it's license & > login with oracle

Re: Hadoop QA failed to build in branch-1 & branch-1.3

2017-06-02 Thread Ted Yu
o use Oracle JDK 7, whose login should we use ? On Thu, Jun 1, 2017 at 7:06 AM, Sean Busbey wrote: > Are we willing to switch to OpenJDK for our Java 7 tests? > > Has anyone checked to see if there's an updated means for install JDK > 7 from Oracle that works? > > On Wed, May

Re: Proposal for HBASE-16415 (Replication in different namespace)

2017-06-08 Thread Ted Yu
Mind putting the below proposal on HBASE-16415 ? Thanks On Thu, Jun 8, 2017 at 3:24 PM, Jan Kunigk wrote: > Hi, with regards to the above JIRA I would like to make the following > contribution. > I am looking very much forward to feedback and comments. > > ReplicationSourceWALReaderThread conti

Re: [ANNOUNCE] New HBase committer Allan Yang

2017-06-08 Thread Ted Yu
Congratulations, Allan ! On Thu, Jun 8, 2017 at 8:49 PM, Yu Li wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Allan Yang > has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Allan's generous contributions thus far and > look

Re: [VOTE] First hbase-2.0.0-alpha-1 Release Candidate is available

2017-06-09 Thread Ted Yu
+1 On Fri, Jun 9, 2017 at 9:16 AM, Stack wrote: > +1 by me. > St.Ack > > On Thu, Jun 8, 2017 at 12:33 AM, Stack wrote: > > > The first release candidate for HBase 2.0.0-alpha-1 is up at: > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-2.0.0-alpha-1RC0/ > > > > Maven artifacts are av

Re: [VOTE] First hbase-2.0.0-alpha-1 Release Candidate is available

2017-06-10 Thread Ted Yu
+1 in reducing redundant warnings. > On Jun 10, 2017, at 1:35 AM, Ashish Singhi wrote: > > Its not an issue. The log warnings are coming by HBASE-9393 patch. If user > Hadoop version is not 2.6.4+ or 2.7.0+ then this warn message will be > logged, notifying user about a CLOSE_WAIT connection le

Re: [ANNOUNCE] New Apache HBase committer Ashu Pachauri

2017-06-16 Thread Ted Yu
Congratulations, Ashu ! On Fri, Jun 16, 2017 at 4:43 PM, Guanghao Zhang wrote: > Congratulations and welcome! > > 2017-06-17 7:27 GMT+08:00 Gary Helmling : > > > On behalf of the Apache HBase PMC, I am pleased to announce that Ashu > > Pachauri has accepted the PMC's invitation to become a commi

Re: [ANNOUNCE] New HBase committer Huaxiang Sun

2017-06-19 Thread Ted Yu
Congratulations, Huaxiang. On Mon, Jun 19, 2017 at 12:30 PM, Sean Busbey wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that > Huaxiang Sun has accepted the PMC's invitation to become a committer > on the project. We appreciate all of Huaxiang's great work thus far > and lo

Re: [DISCUSS] IntelliJ Code Analysis + Code Style

2017-06-19 Thread Ted Yu
bq. we can apply them to both branch-1 and branch-2 Many bug fixes are still targeting 1.x releases. If the stylistic fixes go to branch-1, would that make porting between 1.x releases and branch-1 more cumbersome ? What is the amount of changes for the stylistic fixes you deem applicable ? Chee

Re: Branching branch-1.4, volunteering to RM branch-1.4

2017-06-30 Thread Ted Yu
+1 on Andrew being the RM for 1.4 release.  Original message From: Andrew Purtell Date: 6/30/17 2:37 PM (GMT-08:00) To: dev@hbase.apache.org Subject: Branching branch-1.4, volunteering to RM branch-1.4 Greeting HBasers, It's my intention to create a new release branch, branc

Re: [ANNOUNCE] Devaraj Das joins the Apache HBase PMC

2017-07-05 Thread Ted Yu
Congratulations, Devaraj ! On Wed, Jul 5, 2017 at 9:27 AM, Josh Elser wrote: > I'm pleased to announce yet another PMC addition in the form of Devaraj > Das. One of the "old guard" in the broader Hadoop umbrella, he's also a > long-standing member in our community. We all look forward to the con

Re: Do executing table.get() inside endpoint co-processor invokes a observer's (preGet, postGet etc ) callbacks

2017-07-11 Thread Ted Yu
Which region would be the recipient of the table.get() call ? If that is a different region than the one the endpoint is activated on, you should be aware of the potential deadlock issue. Please take a look at CoprocessorHConnection. FYI On Tue, Jul 11, 2017 at 10:22 PM, Nilkanth Patel wrote:

Re: RegionServer info page content

2017-07-14 Thread Ted Yu
Please go ahead with logging JIRA. On Fri, Jul 14, 2017 at 8:33 AM, Lars George wrote: > Hi, > > On the RS status page it has this: > > "Region names are made of the containing table's name, a comma, the > start key, a comma, and a randomly generated region id. To illustrate, > the region named

Re: Ident String

2017-07-16 Thread Ted Yu
When there're two (or more) region server instances running on the same machine, the ident str can be used to distinguish the instances. There may be other scenarios where the ident str is used. Cheers On Fri, Jul 14, 2017 at 3:55 AM, Lars George wrote: > Hi, > > Was coming across `HBASE_IDENT

Re: [ANNOUNCE] New HBase committer Vikas Vishwakarma

2017-07-28 Thread Ted Yu
Congrats, Vikas! Original message From: Andrew Purtell Date: 7/28/17 6:32 PM (GMT-05:00) To: dev@hbase.apache.org, u...@hbase.apache.org Subject: [ANNOUNCE] New HBase committer Vikas Vishwakarma On behalf of the Apache HBase PMC, I am pleased to announce that Vikas Vishwakarm

Re: [ANNOUNCE] New HBase committer Abhishek Singh Chouhan

2017-07-28 Thread Ted Yu
Congratulations, Abhishek! Original message From: Andrew Purtell Date: 7/28/17 6:32 PM (GMT-05:00) To: dev@hbase.apache.org, u...@hbase.apache.org Subject: [ANNOUNCE] New HBase committer Abhishek Singh Chouhan On behalf of the Apache HBase PMC, I am pleased to announce that

Re: [ANNOUNCE] New HBase committer Mike Drob

2017-08-03 Thread Ted Yu
Congratulations, Mike. (Just got access to gmail). On Tue, Aug 1, 2017 at 8:38 AM, Josh Elser wrote: > On behalf of the Apache HBase PMC, I'm pleased to announce that Mike Drob > has accepted the PMC's invitation to become a committer. > > Mike has been doing some great things lately in the pro

Re: [DISCUSS] Removing jersey1* dependencies from project and jersey1*jars form lib dir

2017-08-03 Thread Ted Yu
Assuming actions in step #1 can be completed, the approach sounds fine. On Thu, Aug 3, 2017 at 2:04 PM, Samir Ahmic wrote: > Hi all, > > Recently i have opened https://issues.apache.org/jira/browse/HBASE-18506 > and it is clear that is caused by mixing jersey1 and jersey2 jars in > classpath. Wi

Re: [DISCUSS] hbase-2.0.0 compatibility expectations

2017-08-03 Thread Ted Yu
I expanded the condition in the filter like this: project = HBASE AND fixVersion in (2.0.0, 2.0.0-alpha-1, 2.0.0-alpha-2, 3.0) AND labels in (incompatibleChange, incompatible, incompatibility) Still there're only two showing up. On Thu, Aug 3, 2017 at 9:07 AM, Zach York wrote: > I tried to fi

Re: Review for nightly build updates

2017-08-05 Thread Ted Yu
The patch looks good. Cheers On Sat, Aug 5, 2017 at 8:21 PM, Sean Busbey wrote: > Hiya folks! > > Could someone please give a review over here: > > https://issues.apache.org/jira/browse/HBASE-18426 > > It's a part of my efforts to update our nightly test infrastructure to > something we keep in

Re: Tags class using wrong length?

2017-08-06 Thread Ted Yu
The byte following the tag length (a short) is the tag type. The current code is correct. On Sun, Aug 6, 2017 at 5:40 AM, Chia-Ping Tsai wrote: > According to the following code: > public ArrayBackedTag(byte tagType, byte[] tag) { > int tagLength = tag.length + TYPE_LENGTH_SIZE; > if

Re: Still Failing: HBase Generate Website

2017-08-09 Thread Ted Yu
Have you looked at the following ? https://builds.apache.org/job/hbase_generate_website/1072/artifact/hbase-install-log-82d554e3783372cc6b05489452c815b57c06f6cd.txt Cheers On Wed, Aug 9, 2017 at 8:25 AM, Mike Drob wrote: > I tried to look at this failure on Jenkins, but couldn't make sense of

Jenkins build for 1.4

2017-08-13 Thread Ted Yu
Hi, https://builds.apache.org/job/HBase-1.4 was pointing to branch-1. I have made the config change to point to branch-1.4 Thanks to Jerry who reported build break in HBASE-18589

Re: Jenkins build for 1.4

2017-08-13 Thread Ted Yu
gt; On Sun, Aug 13, 2017 at 2:38 PM, Ted Yu wrote: > > Hi, > > https://builds.apache.org/job/HBase-1.4 was pointing to branch-1. > > > > I have made the config change to point to branch-1.4 > > > > Thanks to Jerry who reported build break in HBASE-18589 >

Re: [DISCUSS] Remove HTrace 3.2.0-incubating from HBase

2017-08-15 Thread Ted Yu
+1 on removing HTrace 3.2.0-incubating On Tue, Aug 15, 2017 at 10:49 AM, Stack wrote: > On Tue, Aug 15, 2017 at 5:54 AM, Tamas Penzes wrote: > > > Hi All, > > > > As far as I know the actual integration of HTrace 3.2 into HBase is far > > from satisfying. > > > > > Yes. > > > > This version of

Re: Different behavior in ScannerCallables

2017-08-23 Thread Ted Yu
Please open a JIRA. On Wed, Aug 23, 2017 at 5:28 AM, Peter Somogyi wrote: > Hi, > > I noticed that the behavior of ReversedScannerCallable#prepare [1] > and ScannerCallable#prepare [2] methods differ how they > call RpcRetryingCallerWithReadReplicas.getRegionLocations method. > > The reversed sc

Re: Tips for Migrating to Apache HBase on Amazon S3 from HDFS

2017-08-23 Thread Ted Yu
bq. The following diagram summarizes the steps for each option I don't see diagram. Is this writing published somewhere ? On Wed, Aug 23, 2017 at 3:21 AM, RuthEvans wrote: > Starting with Amazon EMR 5.2.0, you have the option to run Apache HBase > on Amazon S3. Runnin

Re: Max queue size in replication

2017-08-25 Thread Ted Yu
Agreed this part of code can be improved. On Fri, Aug 25, 2017 at 3:57 AM, Lars George wrote: > Hi, > > I am looking at the replication code, and it has this line: > > this.queueSizePerGroup = this.conf.getInt("hbase.regionserver.maxlogs", > 32); > > This drives the queue size accepting more WAL

Re: Question on Hadoop QA

2017-08-28 Thread Ted Yu
Jan: If you look at: https://builds.apache.org/job/PreCommit-HBASE-Build/8149/artifact/patchprocess/patch-unit-hbase-server.txt you can see that QA bot excluded known flaky tests: -Dtest.exclude.pattern=... However, there might be a few tests which failed that were not related to your patch (Tes

Re: Folly not installed

2017-08-29 Thread Ted Yu
't ready for downstream consumption yet. > can we please move this discussion to the dev@ list? > > On Tue, Aug 29, 2017 at 11:57 AM, Stack wrote: > > On Tue, Aug 29, 2017 at 8:54 AM, Ted Yu wrote: > > > >> I have successfully run load-client against an OpenStack cluste

Re: build a hbase tall table

2017-08-30 Thread Ted Yu
There are several posts if you search online. A few examples: http://hbase.apache.org/book.html#casestudies.schema.listdata https://community.hortonworks.com/questions/26110/hbase-tall-narrow-or-flat-wide-design.html Cheers On Wed, Aug 30, 2017 at 4:43 AM, Peter Li wrote: > Do anyone know wha

Re: How works scan ?

2017-08-30 Thread Ted Yu
Filter can be applied to Query. Both Scan and Get are subclasses of Query. For Scan, you have SetStartRow() and SetStopRow(). Take a look at core/scan.h for related methods. On Wed, Aug 30, 2017 at 10:17 AM, Andrzej wrote: > In folder hbase-native-client/core/ > I have example: > Scan scan{};

Re: Problem writing .so - libevent

2017-08-30 Thread Ted Yu
Were you using docker ? Was libevent.a generated ? In my docker VM, I have: -rw-r--r-- 1 root root 506746 Aug 16 16:08 buck-out/gen/third-party/gen_libevent/gen_libevent/libevent.a Cheers On Wed, Aug 30, 2017 at 2:49 PM, Andrzej wrote: > I want write shared object using native client classes.

Re: Problem writing .so - libevent

2017-08-30 Thread Ted Yu
libevent.a is system library. >From hbase-native-client/third-party/BUCK : system_libs = [ "lzma", "event", On Wed, Aug 30, 2017 at 3:31 PM, Andrzej wrote: > W dniu 31.08.2017 o 00:27, Ted Yu pisze: > >> Were you using docker ? >> Was libeve

Re: Problem writing .so - libevent

2017-08-30 Thread Ted Yu
In my docker VM, I see: /usr/lib/x86_64-linux-gnu/libevent.a You can try building //core:core first which should generate libevent.a (dependency). Cheers On Wed, Aug 30, 2017 at 5:28 PM, Andrzej wrote: > W dniu 31.08.2017 o 00:35, Ted Yu pisze: > >> libevent.a is system library.

Re: How force rebuild with buck on docker?

2017-09-05 Thread Ted Yu
Have you tried running the following command ? buck clean bq. now it doesn't rebuild Did you mean that buck build didn't detect the change you made to the source file ? On Tue, Sep 5, 2017 at 8:08 AM, Andrzej wrote: > In BUCK I have modified simple-client: > cxx_binary( > name="hbNative",

Re: [DISCUSS] is hbase-spark integration going to make it into HBase 2.0

2017-09-10 Thread Ted Yu
bq. revisit the possibility of an independent release cycle run out of an additional ASF repo. This seems to be more practical than the other alternatives. On Sun, Sep 10, 2017 at 11:37 AM, Sean Busbey wrote: > Hi Folks! > > Our Stack recently gave an updated timeline on HBase 2.0 related > rel

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Ted Yu
bq. we need a test tool similar to ITBLL How about making the following such a tool ? hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestBackupRestore.java On Tue, Sep 12, 2017 at 11:25 AM, Vladimir Rodionov wrote: > >> Vlad: I'm obviously curious to see what you think about this st

Re: [DISCUSS] is hbase-spark integration going to make it into HBase 2.0

2017-09-13 Thread Ted Yu
ink of a reason we'd need to keep it in the main tree in terms of > HBase Java API (it would only rely on public API stuff, right?). > > The lack of folks with time and expertise makes me think that a separate > release cycle makes me think that's the right call. > > On 9/1

Re: [DISCUSS] is hbase-spark integration going to make it into HBase 2.0

2017-09-13 Thread Ted Yu
gt; Looks like consensus to me; at least on it not making 2.0. > > Seems easiest in the short term to leave it in the master branch, unless > some folks are ready to make a push. That puts off deciding how some > separate repo logistics work in hopes we can skip them. > > On Se

Re: [DISCUSS] is hbase-spark integration going to make it into HBase 2.0

2017-09-14 Thread Ted Yu
; downstream any faster. > > On Sep 13, 2017 9:57 PM, "Ted Yu" wrote: > > > If we leave it in the master branch, does that mean the code would not be > > transferred to additional ASF repo ? > > > > If so, that implies the hbase-spark module would not face

Re: Couldn't get dependency '//third-party:folly'

2017-09-14 Thread Ted Yu
Please check that hbase-native-client/third-party/BUCK has the following: folly = add_system_libs( ['folly'], lib_dir='/usr/local/lib', exported_deps=tp_dep_rules,) The folly lib is built when docker is built. On Thu, Sep 14, 2017 at 3:36 AM, Andrzej wrote: > On Mint I can rebuild

Re: Couldn't get dependency '//third-party:folly'

2017-09-14 Thread Ted Yu
Please check that hbase-native-client/third-party/BUCK has the following: folly = add_system_libs( ['folly'], lib_dir='/usr/local/lib', exported_deps=tp_dep_rules,) The folly lib is built when docker is built. On Thu, Sep 14, 2017 at 3:36 AM, Andrzej wrote: > On Mint I can rebuild

Re: [DISCUSS] is hbase-spark integration going to make it into HBase 2.0

2017-09-14 Thread Ted Yu
lt > "set up a different issue tracker". It's *more* steps between someone > who wants to move the effort forward and artifacts in the hands of > downstream folks. > > On Thu, Sep 14, 2017 at 7:00 AM, Ted Yu wrote: > > No one as in no one from hbase community. >

QA bot stalls

2017-09-14 Thread Ted Yu
Hi, I filed INFRA-15084 since none of the precommit jobs is making progress. FYI

Re: [DISCUSS] Introduce the limited private to filter

2017-09-16 Thread Ted Yu
HBASE-9529 was resolved 4 years ago. Are there JIRAs which are more recent that can provide more background for this motion ? Cheers On Sat, Sep 16, 2017 at 4:02 AM, Chia-Ping Tsai wrote: > Hi, Folks! > > We have many powerful callback functions to help user to build amazing > application/serv

Re: [DISCUSS] Helper tool / checklist to facilitate RC testing coverage?

2017-09-18 Thread Ted Yu
bq. have some kind of dashboard where people could "sign up" to test different things on that checklist This makes sense. +1 On Mon, Sep 18, 2017 at 11:49 AM, Misty Stanley-Jones wrote: > I keep feeling like we need a checklist for all the different things that > should be tested when people v

Re: question about TTL deletion

2017-09-21 Thread Ted Yu
Moving dev@ to Bcc. Section #39 is correct. For 70.7.7 , have you looked at the two sections starting http://hbase.apache.org/book.html#compaction.and.deletes ? Basically the 'expired' there doesn't refer to expired hfile(s). Cheers On Thu, Sep 21, 2017 at 2:13 AM, 王晓艳 wrote: > Hi groups, >

Re: Please congratulate our new PMC Chair Misty Stanley-Jones

2017-09-21 Thread Ted Yu
Congratulations, Misty ! On Thu, Sep 21, 2017 at 12:08 PM, Andrew Purtell wrote: > At today's meeting of the Board, Special Resolution B changing the HBase > project Chair to Misty Stanley-Jones was passed unanimously. > > Please join me in congratulating Misty on her new role! > > ​(If you need

Re: [DISCUSS] Increase stability on o.a.h.h.Tag?

2017-09-21 Thread Ted Yu
Can we mark Tag LimitedPrivate ? We know how ATS uses Tags so it should be straight forward to keep their usage intact. On Thu, Sep 21, 2017 at 12:03 PM, Josh Elser wrote: > Hiya, > > (Background, I'm starting what is likely to be an onerous task of looking > through downstream components and s

Re: How force rebuild with buck on docker?

2017-09-22 Thread Ted Yu
Have you tried removing buck-out directory (under hbase-native-client) ? On Fri, Sep 22, 2017 at 7:01 AM, Andrzej wrote: > W dniu 05.09.2017 o 17:25, Ted Yu pisze: > >> Have you tried running the following command ? >> >> buck clean >> > > Nothing helps,

Re: libsasl2.so.3 (branch HBASE-14850)

2017-09-22 Thread Ted Yu
On my docker VM, I found the following: /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 /usr/lib/x86_64-linux-gnu/libsasl2.so.2 /usr/local/lib/libsasl2.so.3.0.0 /usr/local/lib/libsasl2.so.3 Which commit were you using for the branch ? I used: 21c08df9079b8cc9dd1c8c2208a7604fc12fca12 Take a look at

Re: libsasl2.so.3 (branch HBASE-14850)

2017-09-22 Thread Ted Yu
So libsasl2.so.3 is in your docker VM. Can you give the full error w.r.t. libsasl2.so.3 not being opened (I assume you got the error within docker) ? On Fri, Sep 22, 2017 at 9:53 AM, Andrzej wrote: > W dniu 22.09.2017 o 18:19, Ted Yu pisze: > >> On my docker VM, I found t

Re: [DISCUSS] Increase stability on o.a.h.h.Tag?

2017-09-22 Thread Ted Yu
gt; > >>>>> > > >>>>> Thanks. > > >>>>> > > >>>>> > > >>>>>> On 9/21/17 4:25 PM, Sean Busbey wrote: > > >>>>>> > > >>>>>> We have lots of exampl

Re: libsasl2.so.3 (branch HBASE-14850)

2017-09-22 Thread Ted Yu
:57, Ted Yu pisze: > > So libsasl2.so.3 is in your docker VM. > > Can you give the full error w.r.t. libsasl2.so.3 not being opened (I > assume > > you got the error within docker) ? > > No, build is ok within docker, but I can't use it outside docker > > Prev

Re: error installing Cyrus

2017-09-22 Thread Ted Yu
Andrzej: There is http://cyrusimap.web.cmu.edu/old/docs/cyrus-imapd/2.2.13p1/mailing-list.php Please use appropriate mailing list for each specific question. On Fri, Sep 22, 2017 at 11:02 AM, Andrzej wrote: > W dniu 22.09.2017 o 19:10, Ted Yu pisze: > >> Please refer to hbase-n

Re: Failure Maven build

2017-09-23 Thread Ted Yu
tools.jar is available with jdk 1.8 e.g. on Mac: /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/lib/tools.jar See also https://stackoverflow.com/questions/18061887/where-is-tools-jar-located On Sat, Sep 23, 2017 at 2:15 PM, Andrzej wrote: > I clone HBase sources and checkout HB

Re: [HBASE-14850] How build simple-client after changes?

2017-09-24 Thread Ted Yu
You should run buck under hbase-native-client . Source files are now under hbase-native-client/src/hbase/ directory. For building simple-client, you can use: buck build src/hbase/client:simple-client For #2, you'd better not mix your code inside native client library. hbase-native-client/third-

Re: [HBASE-14850] How build simple-client after changes?

2017-09-24 Thread Ted Yu
If you continue using buck, you can refer to the cxx_binary goal of simple-client in src/hbase/client/BUCK for your own app. You can also use make. See Makefile under hbase-native-client Cheers On Sun, Sep 24, 2017 at 10:06 AM, Andrzej wrote: > W dniu 24.09.2017 o 18:43, Ted Yu pi

Re: Empty byte array values for cells which doesn't exist

2017-09-24 Thread Ted Yu
Can you tell us more about this table (e.g. schema) ? If you can formulate a unit test which reproduces this behavior, that would be easier to debug. Which version of hbase are you using ? Cheers On Sun, Sep 24, 2017 at 9:30 PM, Karthick Ram wrote: > Hi, we have a table which when queried wit

Re: HFileOutputFormat2 hardcodes default FileOutputCommitter

2017-09-26 Thread Ted Yu
Hbase doesn't use pull request. Can you open a JIRA and attach patch there ? Thanks Original message From: ShaoFeng Shi Date: 9/26/17 4:00 AM (GMT-08:00) To: dev@hbase.apache.org Subject: Re: HFileOutputFormat2 hardcodes default FileOutputCommitter Here is the pull request:

Re: [DISCUSS] Memstore or MemStore

2017-09-27 Thread Ted Yu
+1 on unifying to MemStore . On Wed, Sep 27, 2017 at 6:49 AM, Chia-Ping Tsai wrote: > hi folks, > > Memstore/MemStore is our core component, but we have two ways of writing > its name. We should unify its name in our code base. Personally, i prefer > "MemStore". > > Any suggestions? > > -- > Ch

Re: [Proposal] Supporting Query Langeage In HBase

2017-09-27 Thread Ted Yu
Document didn't come through. Consider using googledoc, etc On Wed, Sep 27, 2017 at 7:27 AM, Yung-An He wrote: > Hi folks, > > Currently, HBase hasn’t support SQL syntax yet. Many users who are > familiar with SQL syntax can only query data from HBase via Hive, Impala, > Phoenix or other tools

Re: [Proposal] Supporting Query Langeage In HBase

2017-09-27 Thread Ted Yu
> > Here is the link: > https://drive.google.com/file/d/0Bw6_ESGWcwIqYWpRWkFtTFBIQms/view? > usp=sharing > > 2017-09-27 22:34 GMT+08:00 Ted Yu : > > > Document didn't come through. > > > > Consider using googledoc, etc > > > > On Wed, Sep 27,

Re: [DISCUSS] Move Type out of KeyValue

2017-09-28 Thread Ted Yu
How about choosing option #2 ? Cell is annotated Public. On Thu, Sep 28, 2017 at 2:25 AM, Chia-Ping Tsai wrote: > hi folks, > > User is allowed to create custom cell but the valid code of type - > KeyValue#Type - is declared as IA.Private. As i see it, we should expose > KeyValue#Type as Public

Re: Performance issue in the Join query on the HBase tables

2017-09-29 Thread Ted Yu
Have you looked at Phoenix ? https://phoenix.apache.org/joins.html On Fri, Sep 29, 2017 at 3:25 AM, wenxing zheng wrote: > Dear all, > > I have 3 big HBase tables, which all have millions of rows(rows are synced > from MySQL DB via Bin log) and for each HBase table, we have an external > table

Re: Welcome Chia-Ping Tsai to the HBase PMC

2017-09-29 Thread Ted Yu
Congratulations, Chia-Ping. On Fri, Sep 29, 2017 at 3:19 PM, Misty Stanley-Jones wrote: > The HBase PMC is delighted to announce that Chia-Ping Tsai has agreed to > join > the HBase PMC, and help to make the project run smoothly. Chia-Ping became > an > HBase committer over 6 months ago, based o

Re: [HBASE-14850]Will shared object client as task in near future?

2017-09-30 Thread Ted Yu
Please watch HBASE-18901 . libHBaseClient.a and libHBaseClient.so can be generated outside docker. bq. smart pointers, which hinders simple pointers values as arguments and return values I don't quite get what you meant. Can you elaborate ? T

Re: [HBASE-14850]Will shared object client as task in near future?

2017-10-01 Thread Ted Yu
Design and implementation of HBASE-14850 project follows C++ (11/14) standard. Please design your client application accordingly. Cheers On Sun, Oct 1, 2017 at 6:25 AM, Andrzej wrote: > W dniu 30.09.2017 o 14:51, Ted Yu pisze: > >> bq. smart pointers, which hinders simple pointe

Re: [DISCUSS] update our imports layout

2017-10-01 Thread Ted Yu
bq. hold our attraction I guess you meant attention. The suggestions under Q1 are good. On Sun, Oct 1, 2017 at 8:27 AM, Chia-Ping Tsai wrote: > hi folks, > > I noticed the code conflict occurs on the imports frequently. To resolve > the conflict is a complete waste of time, so i feel it is t

Re: [DISCUSS] update our imports layout

2017-10-01 Thread Ted Yu
t 9:09 AM, Chia-Ping Tsai > wrote: > > > bq. I guess you meant attention. > > You are right. sorry for the misspelling. ☹ > > > > On 2017-10-01 23:33, Ted Yu wrote: > > > bq. hold our attraction > > > > > > I guess you meant attention. &g

Re: [NOTICE] PreCommit now running against Hadoop3 artifacts successfully

2017-10-01 Thread Ted Yu
I was looking under https://builds.apache.org/job/PreCommit-HBASE-Build/8875 but didn't seem to find the output which shows the compilation error against hadoop-3. Do you know if the output can be retrieved from Jenkins or, does developer have to perform build against hadoop-3 locally ? Thanks, J

Re: [NOTICE] PreCommit now running against Hadoop3 artifacts successfully

2017-10-01 Thread Ted Yu
//builds.apache.org/job/PreCommit-HBASE-Build/8875/ > artifact/patchprocess/patch-javac-3.0.0-alpha4.txt > > these aren't super intuitive names, maybe you could update them to > include 'hadoopcheck' or something like that? > > On Sun, Oct 1, 2017 at 4:01 PM, Ted

Re: [DISCUSS] Move Type out of KeyValue

2017-10-02 Thread Ted Yu
If CellType is added, should the following method of Cell be affected ? /** * @return The byte representation of the KeyValue.TYPE of this cell: one of Put, Delete, etc */ byte getTypeByte(); Ideally CellType should be returned instead of a byte. On Mon, Oct 2, 2017 at 1:54 AM, Chia

Re: If possible read families from tables and (more important) qualifiers?

2017-10-05 Thread Ted Yu
Did you use scan ? Cheers Original message From: Andrzej Date: 10/5/17 12:03 AM (GMT-08:00) To: dev Subject: Re: If possible read families from tables and (more important) qualifiers? W dniu 05.10.2017 o 08:01, Sean Busbey pisze: > Presuming this is the using the C++ client

Re: If possible read families from tables and (more important) qualifiers?

2017-10-05 Thread Ted Yu
See Enis' comment: https://issues.apache.org/jira/browse/HBASE-14850?focusedCommentId=15840799&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15840799 though it was half year old. On Thu, Oct 5, 2017 at 8:53 AM, Sean Busbey wrote: > I believe there is an umbrella

Jenkins build for 1.3 failing with NullPointerException

2017-10-13 Thread Ted Yu
Hi, >From https://builds.apache.org/job/HBase-1.3-JDK7/307/console : [ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce (min-maven-min-java-banned-xerces) on project hbase: Execution min-maven-min-java-banned-xerces of goal org.apache.maven.plugins:maven

Re: Jenkins build for 1.3 failing with NullPointerException

2017-10-13 Thread Ted Yu
Oct 13, 2017 at 10:52 AM, Ted Yu wrote: > > > Hi, > > From https://builds.apache.org/job/HBase-1.3-JDK7/307/console : > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-enforcer-plugin:3.0.0-M1:enforce > > (min-maven-min-java-banned-xerc

Re: Jenkins build for 1.3 failing with NullPointerException

2017-10-13 Thread Ted Yu
g/view/H-L/view/HBase/job/HBase%20Nightly/ > > On Fri, Oct 13, 2017 at 12:12 PM, Ted Yu wrote: > > Thanks for taking a look. > > > > Logged INFRA-15275 > > > > On Fri, Oct 13, 2017 at 10:09 AM, Mike Drob wrote: > > > >> I am not able to reproduce th

Re: [DISCUSS] HBASE-18978 Table and AsyncTable alignment

2017-10-13 Thread Ted Yu
Nice spreadsheet, Peter. w.r.t. Different return types, I took a look at the discussion on HBASE-18912. I think that changing the return type only doesn't have to be done in this iteration. Cheers On Fri, Oct 13, 2017 at 5:16 PM, Peter Somogyi wrote: > Hi, > > I started to work on HBASE-18978

Re: [DISCUSS] Merge FilterList Improvement - Branch HBASE-18410

2017-10-19 Thread Ted Yu
Some of recent patches, such as HBASE-18368-HBASE-18410.v2.patch, didn't get proper QA run (due to precommit disruption). We'd better get several good QA runs. Cheers On Thu, Oct 19, 2017 at 5:38 PM, 张铎(Duo Zhang) wrote: > I believe there are several UTs which we want them to be the guard of >

QA test runs timed out for branch-1.x

2017-10-21 Thread Ted Yu
Hi, Looking at https://builds.apache.org/job/PreCommit-HBASE-Build/ , there were 4 timed out builds (HBASE-19019, etc). It seems each of them was for branch-1.x Toward the end of console log, I saw: *11:34:26* Build timed out (after 360 minutes). Marking the build as failed.*11:34:26* ERROR: Coul

Re: QA test runs timed out for branch-1.x

2017-10-22 Thread Ted Yu
we build in docker, unless someone manually runs a > build and unselects "run in docker". > > > > On Sat, Oct 21, 2017 at 10:12 AM, Ted Yu wrote: > > Hi, > > Looking at https://builds.apache.org/job/PreCommit-HBASE-Build/ , there > > were 4 timed out builds (HBA

Re: [ANNOUNCE] New HBase committer Zheng Hu

2017-10-23 Thread Ted Yu
Congratulations,  Cheng.  Original message From: libis Date: 10/22/17 11:50 PM (GMT-08:00) To: dev@hbase.apache.org Subject: Re: [ANNOUNCE] New HBase committer Zheng Hu Congratulations!!! 2017-10-23 14:21 GMT+08:00 ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com>: >

Re: [ANNOUNCE] New HBase Committer Jan Hentschel

2017-10-26 Thread Ted Yu
Congratulations, Jan ! On Thu, Oct 26, 2017 at 3:39 PM, Stack wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Jan > Hentschel has accepted the PMC's invitation to become a committer on > the project. > > We appreciate all of Jan' great work thus far and look forward to

Re: Struggles around Cell#getType()

2017-10-26 Thread Ted Yu
There is also CellBuilder#DataType which is public. However, the ordinals of CellBuilder#DataType are different from KeyValue.Type . What if we align the ordinals of CellBuilder#DataType to be the same as those from KeyValue.Type ? On Thu, Oct 26, 2017 at 4:34 PM, Sergey Soldatov wrote: > DataT

Re: Struggles around Cell#getType()

2017-10-26 Thread Ted Yu
> sort of API in CellUtl like you already have isDelete(Cell). > > > > Regards > > Ram > > > > On Fri, Oct 27, 2017 at 9:08 AM, Ted Yu wrote: > > > >> There is also CellBuilder#DataType which is public. However, the > ordinals > >> of CellBuilde

Re: Struggles around Cell#getType()

2017-10-27 Thread Ted Yu
ot having a type state > > and make it align with those in KeyValue#Type. Relying on ordinal > > might be problematic. Also we can have DataType#toType(Cell) or so > > for the conversion purpose. This is needed for CPs as noted by Josh's > > CP eg:s. Thanks for the nice f

<    8   9   10   11   12   13   14   15   16   17   >