[jira] [Resolved] (HBASE-17352) Fix hbase-assembly build with bash 4

2017-05-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17352. Resolution: Fixed Fix Version/s: 1.1.11 1.3.2 1.2.6

[jira] [Resolved] (HBASE-18040) TestBlockEvictionFromClient fails in master branch

2017-05-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-18040. Resolution: Duplicate Assignee: (was: ramkrishna.s.vasudevan) See HBASE-18055

Re: HBASE and MOB

2017-05-15 Thread Ted Yu
as > the > > code base has lots of differences. > > > > Regards, > > Ashish > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: 12 May 2017 22:25 > > To: u...@hbase.apache.org > > Subjec

[jira] [Created] (HBASE-18040) TestBlockEvictionFromClient fails in master branch

2017-05-12 Thread Ted Yu (JIRA)
Ted Yu created HBASE-18040: -- Summary: TestBlockEvictionFromClient fails in master branch Key: HBASE-18040 URL: https://issues.apache.org/jira/browse/HBASE-18040 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-18034) Only two Backup tests are run by QA

2017-05-11 Thread Ted Yu (JIRA)
Ted Yu created HBASE-18034: -- Summary: Only two Backup tests are run by QA Key: HBASE-18034 URL: https://issues.apache.org/jira/browse/HBASE-18034 Project: HBase Issue Type: Test

Re: [VOTE] Merge space quota branch (HBASE-16961) into master

2017-05-09 Thread Ted Yu
+1 on merging this to master branch. I have reviewed Josh's work for phase 1. This is an important addition for multi-tenant deployments. On Fri, May 5, 2017 at 4:24 PM, Josh Elser wrote: > Folks, > > This is a vote to (rebase and) merge the branch HBASE-16961 into master. >

Re: Query Hbase

2017-05-07 Thread Ted Yu
Thank You > > Could send an example is which of the options and more performative ?? > > > > Em 7 de mai de 2017, às 18:16, Ted Yu-3 [via Apache HBase] < > ml+s679495n408786...@n3.nabble.com> escreveu: > > > > SingleColumnValueFilter can be used on one colu

Re: Query Hbase

2017-05-07 Thread Ted Yu
SingleColumnValueFilter can be used on one column. You can use FilterList to chain multiple SingleColumnValueFilter together. Cheers On Sun, May 7, 2017 at 10:56 AM, Developer Brasil < alfredo.tava...@terra.com.br> wrote: > How do I query multiple columns with filters in hbase? > In sql it

Re: flaky test report

2017-05-05 Thread Ted Yu
lds. > > On Fri, May 5, 2017 at 3:13 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Hi, > > I was looking at > > https://builds.apache.org/job/HBASE-Find-Flaky-Tests/ > > lastSuccessfulBuild/artifact/dashboard.html > > > > When I clicked on some of t

flaky test report

2017-05-05 Thread Ted Yu
Hi, I was looking at https://builds.apache.org/job/HBASE-Find-Flaky-Tests/lastSuccessfulBuild/artifact/dashboard.html When I clicked on some of the run Ids, e.g. https://builds.apache.org/job/HBASE-Flaky-Tests//15564 I got status 404. Does someone know what happened to the builds ? Thanks

[jira] [Created] (HBASE-17997) jruby-complete-1.6.8.jar is in cached_classpath.txt

2017-05-04 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17997: -- Summary: jruby-complete-1.6.8.jar is in cached_classpath.txt Key: HBASE-17997 URL: https://issues.apache.org/jira/browse/HBASE-17997 Project: HBase Issue Type: Bug

Re: Sporadically failing precommit tasks

2017-05-02 Thread Ted Yu
[3] [4] are for master branch. Don't know why branch-1 testing is "special". On Tue, May 2, 2017 at 8:41 AM, Josh Elser wrote: > I've been running into an issue where the PreCommit job fails when > building the Yetus Docker image because it attempts to fetch a version of >

Re: Time to retire EOM branch releases from dist?

2017-04-30 Thread Ted Yu
+1 On Sun, Apr 30, 2017 at 5:29 PM, Nick Dimiduk wrote: > Heya, > > I noticed we still have hbase-0.94.27 and hbase-1.0.3 syncing out on the > mirrors [0]. Since both of these lines are formally EOM, I think it's time > to retire the bits as well. Of course, people can

[jira] [Resolved] (HBASE-17487) Log error when pushing pipeline to snapshot fails twice

2017-04-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17487. Resolution: Later > Log error when pushing pipeline to snapshot fails tw

Re: org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot broken in branch-1?

2017-04-26 Thread Ted Yu
You can take a look at: https://builds.apache.org/job/HBASE-Find-Flaky-Tests/lastSuccessfulBuild/artifact/dashboard.html It seems the test is flaky. FYI On Wed, Apr 26, 2017 at 2:25 PM, Stephen Jiang wrote: > I am running

Re: Pre commit job is broken on H0

2017-04-25 Thread Ted Yu
Infra has taken some action. I manually triggered a QA run which seems to get past git checkout step: https://builds.apache.org/job/PreCommit-HBASE-Build/6559/console FYI On Mon, Apr 24, 2017 at 8:25 AM, Ted Yu <yuzhih...@gmail.com> wrote: > Logged INFRA-13985 - this problem aff

Re: Pre commit job is broken on H0

2017-04-24 Thread Ted Yu
Logged INFRA-13985 - this problem affects wide ranging precommit jobs. On Mon, Apr 24, 2017 at 8:17 AM, Ted Yu <yuzhih...@gmail.com> wrote: > From https://builds.apache.org/job/PreCommit-HBASE-Build/6545/console , > H7 was involved as well. > > On Mon, Apr 24, 2017 at 8:1

Re: Pre commit job is broken on H0

2017-04-24 Thread Ted Yu
>From https://builds.apache.org/job/PreCommit-HBASE-Build/6545/console , H7 was involved as well. On Mon, Apr 24, 2017 at 8:16 AM, 张铎(Duo Zhang) wrote: > It first failed on qnode3. But after I remove qnode3 from the machine list, > it failed on H2 with the same error. > >

[jira] [Created] (HBASE-17949) Shorten the execution time of TestBackupMultipleDeletes

2017-04-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17949: -- Summary: Shorten the execution time of TestBackupMultipleDeletes Key: HBASE-17949 URL: https://issues.apache.org/jira/browse/HBASE-17949 Project: HBase Issue Type: Test

[jira] [Resolved] (HBASE-17523) Add Timeline Consistency support to hbase-thrift

2017-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17523. Resolution: Later > Add Timeline Consistency support to hbase-thr

[jira] [Resolved] (HBASE-17400) TestHRegion#testWritesWhileScanning occasionally hangs in MVCC#.waitForRead()

2017-04-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17400. Resolution: Cannot Reproduce > TestHRegion#testWritesWhileScanning occasionally hangs in MVCC#.waitForR

Re: Some of the JIRA notifications not received

2017-04-17 Thread Ted Yu
During which period did you observe such behavior ? Have you checked the spam folder of respective email account ? For me, I haven't noticed such problem in the recent past. On Mon, Apr 17, 2017 at 6:05 PM, Allan Yang wrote: > Hi, All > Both of my E-mail

[jira] [Created] (HBASE-17934) Backport HBASE-17779 "disable_table_replication returns misleading message and does not turn off replication" to branch-1.3

2017-04-17 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17934: -- Summary: Backport HBASE-17779 "disable_table_replication returns misleading message and does not turn off replication" to branch-1.3 Key: HBASE-17934 URL: https://issues.apach

Re: A new Mutilple-Type Queue idea to handle multiple workloads

2017-04-16 Thread Ted Yu
bq. client-3 will ran out of all handler threads of the get-queue Looks like you meant to say that client-3 would occupy all handlers. The pictures didn't go through. Since you have code for this improvement, consider opening JIRA where you can publish your patch and pictures so that we get

Re: ANNOUNCE: Yu Li joins the Apache HBase PMC

2017-04-14 Thread Ted Yu
Congratulations, Yu ! On Fri, Apr 14, 2017 at 7:22 AM, Anoop John wrote: > On behalf of the Apache HBase PMC I"m pleased to announce that Yu Li > has accepted our invitation to become a PMC member on the Apache HBase > project. He has been an active contributor to HBase

[jira] [Created] (HBASE-17902) Backport HBASE-16367 "Race between master and region server initialization may lead to premature server abort" to 1.3

2017-04-11 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17902: -- Summary: Backport HBASE-16367 "Race between master and region server initialization may lead to premature server abort" to 1.3 Key: HBASE-17902 URL: https://issues.apache.org/j

Re: [DISCUSS] Status of the 0.98 release line

2017-04-10 Thread Ted Yu
+1 Andrew has done tremendous work. On Mon, Apr 10, 2017 at 12:17 PM, Mikhail Antonov wrote: > +1 to EOL 0.98. > > Thanks Andrew for all the work maintaining it! > > -Mikhail > > On Mon, Apr 10, 2017 at 12:10 PM, Dima Spivak > wrote: > > > +1 > > >

Re: [VOTE] Second release candidate for HBase 1.3.1 (RC1) is available

2017-04-10 Thread Ted Yu
+1 Checked sums and signatures: Okay Ran test suite (1.8.0_91): Okay RAT check: Okay On Sun, Apr 9, 2017 at 9:40 AM, Andrew Purtell wrote: > +1 > > Checked sums and signatures: ok > Built from source: ok (7u80) > RAT check passes: ok > Unit test suite passes: ok (7u80) >

Re: Move the 'stable' pointer for HBase in dist.apache.org to 1.3.0 ?

2017-04-10 Thread Ted Yu
cause I made a provisional > remark on the board report about 1.3.0. If possible let's keep this on > topic. Thanks. > > > On Mon, Apr 10, 2017 at 10:50 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Release 1.3.1 seems to have high chance of passing. > > > > How abo

Re: Move the 'stable' pointer for HBase in dist.apache.org to 1.3.0 ?

2017-04-10 Thread Ted Yu
Release 1.3.1 seems to have high chance of passing. How about using 1.3.1 as stable release ? On Mon, Apr 10, 2017 at 10:28 AM, Andrew Purtell wrote: > Shall we move the 'stable' pointer for HBase in dist.apache.org to release > 1.3.0 ? > > > -- > Best regards, > >-

Re: How threads interact with each other in HBase

2017-04-02 Thread Ted Yu
ugh for FSYNC_WAL which is not the default > option, > > you should probably do it because the documentation explicitly promised > > it). > > > > > > I just want to make sure my description about HBase is accurate, > including > > the durability aspect. > >

Re: How threads interact with each other in HBase

2017-04-02 Thread Ted Yu
("grouping" the writes together). When one caller's future would > > complete, > > >> what really happened is that the write/sync which included the > caller's > > >> update was committed (along with others). All of this is happening > > inside &

Re: hbase does not seem to handle mixed workloads well

2017-04-01 Thread Ted Yu
on your settings. You can use the "Debug dump" from the > > regionserver we UI or jstack to inspect what the "handler" threads are > > doing. > > > > Enis > > > > On Fri, Mar 31, 2017 at 7:57 PM, 杨苏立 Yang Su Li <yangs...@gmail.com>

Re: hbase does not seem to handle mixed workloads well

2017-03-31 Thread Ted Yu
Can you tell us which release of hbase you used ? Please describe values for the config parameters in hbase-site.xml Do you have SSD(s) in your cluster ? If so and the mixed workload involves writes, have you taken a look at HBASE-12848 ? Cheers On Fri, Mar 31, 2017 at 7:29 PM, 杨苏立 Yang Su Li

[jira] [Created] (HBASE-17860) Implement secure native client connection

2017-03-31 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17860: -- Summary: Implement secure native client connection Key: HBASE-17860 URL: https://issues.apache.org/jira/browse/HBASE-17860 Project: HBase Issue Type: Sub-task

Re: [DISCUSS] Status of 0.94 release line

2017-03-29 Thread Ted Yu
Yes, I think so. On Wed, Mar 29, 2017 at 6:54 AM, Sean Busbey wrote: > Hi Folks! > > It's been 2 years since there's been a release on the 0.94 line. Shall > we consider it end-of-maintenance? > > -busbey >

Re: hbase configuration

2017-03-29 Thread Ted Yu
Not sure what you meant by pointing cluster to a new server. Normally user places hbase-site.xml which specifies the cluster config on a node where client application is launched. bq. clear all the previous data stored in hbase tables Please take a look at

Re: [DISCUSS] What are we going to call the releases leading up to HBase 2.0?

2017-03-28 Thread Ted Yu
2.0.0-alpha / 2.0.0-beta sound good to me. On Tue, Mar 28, 2017 at 1:25 PM, Enis Söztutar wrote: > I would automatically -1 any release with a number like 1.99 regardless of > content. > > Semantic versioning which we are following already provides an answer for > this: >

[jira] [Resolved] (HBASE-17841) ServerCrashProcedure is not triggered when meta server with unflushed edits is aborted

2017-03-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17841. Resolution: Cannot Reproduce The sample test didn't reflect setup for master branch where master hosts

Re: How threads interact with each other in HBase

2017-03-27 Thread Ted Yu
Again, attachment didn't come thru. Is it possible to formulate as google doc ? Thanks On Mon, Mar 27, 2017 at 6:19 PM, 杨苏立 Yang Su Li wrote: > Hi, > > I am a graduate student working on scheduling on storage systems, and we > are interested in how different threads in

[jira] [Created] (HBASE-17841) ServerCrashProcedure is not triggered when meta server with unflushed edits is aborted

2017-03-27 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17841: -- Summary: ServerCrashProcedure is not triggered when meta server with unflushed edits is aborted Key: HBASE-17841 URL: https://issues.apache.org/jira/browse/HBASE-17841 Project

[jira] [Resolved] (HBASE-15075) Allow region split request to carry identification information

2017-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-15075. Resolution: Won't Fix > Allow region split request to carry identification informat

Re: How threads interact with each other in HBase

2017-03-22 Thread Ted Yu
Attachment didn't come thru. Upload to googledoc ? On Wed, Mar 22, 2017 at 1:39 PM, 杨苏立 Yang Su Li wrote: > Hi, > > I am a graduate student working on scheduling on storage systems, and we > are interested in how different threads in HBase interact with each other > and how

Re: [DISCUSS] moving to Apache Yetus Audience Annotations

2017-03-20 Thread Ted Yu
Sean: Can you log a JIRA so that we can move this forward ? Cheers On Mon, Mar 20, 2017 at 2:20 PM, Josh Elser <els...@apache.org> wrote: > Sean Busbey wrote: > >> On Mon, Mar 20, 2017 at 11:09 AM, Ted Yu<yuzhih...@gmail.com> wrote: >> >>> Is Yetu

Re: [DISCUSS] moving to Apache Yetus Audience Annotations

2017-03-20 Thread Ted Yu
Is Yetus 0.4.0 release stable ? If we use Yetus annotations, is there only one jar pulled in as dependency ? Cheers On Mon, Mar 20, 2017 at 7:26 AM, Sean Busbey wrote: > Hi folks! > > I'd like us to start moving towards using the audience annotations > from the Apache Yetus

[jira] [Created] (HBASE-17806) TestRSGroups#testMoveServersAndTables is flaky in master branch

2017-03-19 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17806: -- Summary: TestRSGroups#testMoveServersAndTables is flaky in master branch Key: HBASE-17806 URL: https://issues.apache.org/jira/browse/HBASE-17806 Project: HBase Issue

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

2017-03-17 Thread Ted Yu
Congratulations ! On Fri, Mar 17, 2017 at 3:30 PM, Anoop John wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping > Tsai > has accepted the PMC's invitation to become a committer on the project. We > appreciate all of his contributions thus

[jira] [Resolved] (HBASE-17758) [RSGROUP] Add shell command to move servers and tables at the same time

2017-03-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17758. Resolution: Fixed > [RSGROUP] Add shell command to move servers and tables at the same t

[jira] [Reopened] (HBASE-17707) New More Accurate Table Skew cost function/generator

2017-03-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-17707: > New More Accurate Table Skew cost function/genera

Re: About adding methods to an interface which is part of our public API in minor release

2017-03-16 Thread Ted Yu
+1 to what Josh and James said. On Thu, Mar 16, 2017 at 11:02 AM, Josh Elser wrote: > +1 to the JDK8 default implementation approach. I'd say this would be good > to push forward for the future. > > For 1.x, I see no reason why we couldn't provide concrete implementations >

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-15 Thread Ted Yu
Clarification: Due to the divergence of HBASE-7912 branch from master branch, I think the conclusion of this vote means that mega patch v61 on HBASE-14123 would be integrated to master branch directly (with credit to people who contributed). On Wed, Mar 15, 2017 at 5:51 PM, Ted Yu <yuz

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-15 Thread Ted Yu
gt;>>>> productive for the HBase community. Realistically, we cannot have the >>>>>>> luxury of having to wait another couple of months and doing yet >>>>>>> another >>>>>>> giant round of reviews because the code base i

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-13 Thread Ted Yu
os/asf/hbase.git > - [deleted] 14123 > > > On Mon, Mar 13, 2017 at 4:13 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > I tried to delete the HBASE-14123 branch using commands I found on > > http://stackoverflow.com/questions/2003505/how-to- > > delete-a-

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-13 Thread Ted Yu
who were not following our lengthy conversation on a review > > board, separation of a backup code into a separate module has been > > done last year, but has been reverted back by request of a reviewer. > > > > > > -Vladimir > > > > On Mon, Mar 13, 2017 at 2:23 P

[jira] [Resolved] (HBASE-10965) Automate detection of presence of Filter#filterRow()

2017-03-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-10965. Resolution: Won't Fix > Automate detection of presence of Filter#filter

[jira] [Resolved] (HBASE-11132) Create tool that facilitates diagnosis of integration test failures

2017-03-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-11132. Resolution: Later > Create tool that facilitates diagnosis of integration test failu

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-10 Thread Ted Yu
HBASE-14123 branch has been created, with Vlad's mega patch v61. FYI On Fri, Mar 10, 2017 at 3:30 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Thanks for the feedback, Andrew. > > How about the following plan: > > create branch HBASE-14123 off of master with mega patch v61

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-10 Thread Ted Yu
SE-14135 HBase Backup/Restore Phase 3: Merge backup images > > >>>> * HBASE-14141 HBase Backup/Restore Phase 3: Filter WALs on backup to > > >>>> include only edits from backup tables (Patch available) > > >>>> * HBASE-17133 Backup documentation > > &g

Re: branch-2

2017-03-10 Thread Ted Yu
; > IIRC, the last round of clean ups was in March 2016 on HBASE-15006. > Maybe time for another go? > > > > On Thu, Mar 9, 2017 at 5:09 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > Hi, > > I was wondering why there is branch-2 ? > > > > https://github.com/ap

[jira] [Resolved] (HBASE-11033) Allow test-patch.sh to run selected test(s) if patch contains changes to test classes only

2017-03-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-11033. Resolution: Won't Fix > Allow test-patch.sh to run selected test(s) if patch contains changes to t

branch-2

2017-03-09 Thread Ted Yu
Hi, I was wondering why there is branch-2 ? https://github.com/apache/hbase/tree/branch-2 As far as I know, there is no consensus on when branch-2 should be created. Thanks

Re: What if I want to write another table in MasterObserver.preModifyColumnFamily ?

2017-03-09 Thread Ted Yu
Need to carefully done though! > > > > -Anoop- > > > > On Wed, Mar 8, 2017 at 8:26 AM, Xi Yang <alex.xi.y...@gmail.com> wrote: > > > Got it. I appreciate your help! > > > > > > 2017-03-07 17:05 GMT-08:00 Ted Yu <yuzhih...@gmail.c

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-09 Thread Ted Yu
t; > Configuration > > > > Backup is disabled, by default. To enable it, the following configuration > > properties must be added to hbase-site.xml: > > > > hbase.backup.enable=true > > hbase.master.logcleaner.plugins=YOUR_PLUGINS,org. > > apache.hadoop.hbase.backup.master.Back

Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017

2017-03-08 Thread Ted Yu
nserver.classes=YOUR_CLASSES,org. > apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureMa > nager > > > I would like to thank IBM team and Jerry He for original work, > > Enis, Ted, Stack, Matteo, Jerry for time spent on code reviews > > Special thank

Re: hbase build sizes

2017-03-08 Thread Ted Yu
e, just a heads up to the committers that contributors > will have questions if things fail and the logs didn't get properly > zipped up. > > @Ted Yu I also undid your change of keeping builds for only 3 days. > Please don't change the retention period; 3 days is not enough time > for us reas

Re: hbase build sizes

2017-03-08 Thread Ted Yu
For PreCommit-HBASE-Build, I have cut down days to keep builds from 14 to 3. For HBase-1.3-JDK8, the fields is empty. Not sure what the default is. "/configure" loaded vey slowly. I can try other builds later. Cheers On Wed, Mar 8, 2017 at 12:31 PM, Chris Lambertus wrote: >

[jira] [Resolved] (HBASE-17728) Create separate build target for Configuration classes

2017-03-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17728. Resolution: Fixed Hadoop Flags: Reviewed > Create separate build target for Configuration clas

Re: What if I want to write another table in MasterObserver.preModifyColumnFamily ?

2017-03-07 Thread Ted Yu
L of Table: employee ColumnFamily: primary' > > I try to use preModifyColumnFamily to do this stuff. > > Thanks, > Alex > > > 2017-03-07 12:12 GMT-08:00 Ted Yu <yuzhih...@gmail.com>: > > > Describing your use case would allow people to give better answer. >

Re: What if I want to write another table in MasterObserver.preModifyColumnFamily ?

2017-03-07 Thread Ted Yu
Describing your use case would allow people to give better answer. What kind of data do you write to other table in preModifyColumnFamily() ? Cross server call within observer is not good idea. Take a look at ConnectionUtils.createShortCircuitConnection(). Cheers On Tue, Mar 7, 2017 at 11:42

Re: HDFS Balancer

2017-03-07 Thread Ted Yu
still be missing, I am wondering > what needs to be done here. > > Makes sense? > > Lars > > Sent from my iPhone > > > On 6 Mar 2017, at 19:50, Ted Yu <yuzhih...@gmail.com> wrote: > > > > w.r.t. the first question, the quoted paragraph came from: > &g

Re: HDFS Balancer

2017-03-06 Thread Ted Yu
w.r.t. the first question, the quoted paragraph came from: HBASE-15332 Document how to take advantage of HDFS-6133 in HBase On Mon, Mar 6, 2017 at 6:38 PM, Lars George wrote: > Hi, > > I am trying to grok what came out of all these issues about the HDFS > balancer and

[jira] [Resolved] (HBASE-17680) Run mini cluster through JNI in tests

2017-03-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17680. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Enis. > Run mini cluster thro

[jira] [Reopened] (HBASE-17707) New More Accurate Table Skew cost function/generator

2017-03-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-17707: TestDefaultLoadBalancer got flaky since this went in. > New More Accurate Table Skew cost function/genera

Re: hbase-default.xml seems to be for an older version of HBase

2017-03-03 Thread Ted Yu
w.r.t. mixed path separators, were you referring to: mkdir -p "$outputDirectory/org/apache/hadoop/hbase" cat >"$outputDirectory/org/apache/hadoop/hbase/Version.java" < wrote: > The issue is the mixed path separators being passed to the script > saveVersion.sh > > I recompiled on Ubuntu and

[jira] [Created] (HBASE-17728) Separate Configuration into common module

2017-03-03 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17728: -- Summary: Separate Configuration into common module Key: HBASE-17728 URL: https://issues.apache.org/jira/browse/HBASE-17728 Project: HBase Issue Type: Sub-task

Re: Scalability Bugs in HBase

2017-02-28 Thread Ted Yu
On page 4: The PIL-replaced functions are still manually picked and replaced. The next major task is to make the whole process automated and find more bugs. Do you have estimate when the task of automation would be completed ? Thanks On Mon, Feb 27, 2017 at 8:25 PM, Tanakorn Leesatapornwongsa <

Re: Scalability Bugs in HBase

2017-02-27 Thread Ted Yu
rowse/HBASE-7060 > > Best, > Tanakorn L. > > > > On Feb 27, 2017, at 10:43 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > The references only listed C* bugs. > > Can you tell us which 9 hbase bugs you have analyzed ? > > Thanks > > On Mon, Feb 27, 2017 at 8:2

Re: Scalability Bugs in HBase

2017-02-27 Thread Ted Yu
The references only listed C* bugs. Can you tell us which 9 hbase bugs you have analyzed ? Thanks On Mon, Feb 27, 2017 at 8:25 PM, Tanakorn Leesatapornwongsa < tanak...@cs.uchicago.edu> wrote: > Dear HBase team, > > We are CS researchers at the University of Chicago. In our recent > research,

[jira] [Created] (HBASE-17703) TestThriftServerCmdLine is flaky in master branch

2017-02-27 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17703: -- Summary: TestThriftServerCmdLine is flaky in master branch Key: HBASE-17703 URL: https://issues.apache.org/jira/browse/HBASE-17703 Project: HBase Issue Type: Test

[jira] [Resolved] (HBASE-17038) Allow verifyrep to persist row keys

2017-02-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17038. Resolution: Later > Allow verifyrep to persist row k

[jira] [Resolved] (HBASE-16571) Consider locking target table(s) during restore operation

2017-02-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16571. Resolution: Later > Consider locking target table(s) during restore operat

Re: [DISCUSS] Tracking HBase Snapshots for Space Quotas

2017-02-23 Thread Ted Yu
Josh: The design doc in [1] is View only. Can you give viewers permission to comment ? On Wed, Feb 22, 2017 at 2:04 PM, Josh Elser wrote: > Hiya folks, > > As we're wrapping up on the current set of features listed in HBASE-16961 > for tracking and limiting the HDFS space

[jira] [Created] (HBASE-17680) Run mini cluster through JNI in tests

2017-02-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17680: -- Summary: Run mini cluster through JNI in tests Key: HBASE-17680 URL: https://issues.apache.org/jira/browse/HBASE-17680 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-17672) "Grant should set access rights appropriately" test fails

2017-02-20 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17672: -- Summary: "Grant should set access rights appropriately" test fails Key: HBASE-17672 URL: https://issues.apache.org/jira/browse/HBASE-17672 Project: HBase

[jira] [Resolved] (HBASE-16112) TestFlushSnapshotFromClient and TestMobFlushSnapshotFromClient are flaky

2017-02-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16112. Resolution: Cannot Reproduce > TestFlushSnapshotFromClient and TestMobFlushSnapshotFromClient are fl

Re: mark 1.3.0 as released version

2017-02-16 Thread Ted Yu
nd do a > diff > > against the version from the actual release tarball to make sure that if > > any jira is marked with the fix version after the release. > > > > Enis > > > > On Thu, Feb 16, 2017 at 8:39 AM, Ted Yu <yuzhih...@gmail.com> wrote: > >

[jira] [Created] (HBASE-17657) TestZKAsyncRegistry is flaky

2017-02-16 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17657: -- Summary: TestZKAsyncRegistry is flaky Key: HBASE-17657 URL: https://issues.apache.org/jira/browse/HBASE-17657 Project: HBase Issue Type: Test Reporter: Ted

Re: Seems our HBASE-1.4 build keeps failing on H13

2017-02-16 Thread Ted Yu
FRA-13519 > > 2017-02-15 20:01 GMT+08:00 Ted Yu <yuzhih...@gmail.com>: > > > Please file an INFRA issue. > > > > > On Feb 15, 2017, at 12:33 AM, 张铎(Duo Zhang) <palomino...@gmail.com> > > wrote: > > > > > > https://builds.apache.org/job/HBas

Re: mark 1.3.0 as released version

2017-02-16 Thread Ted Yu
I have made the change. FYI On Thu, Feb 16, 2017 at 8:26 AM, Sean Busbey <bus...@apache.org> wrote: > yes, it should be. with a release date of 01/17/2017. > > Anyone with admin rights on the jira project should be able to do this. > > Thanks Ted! > > On Thu, Feb 1

mark 1.3.0 as released version

2017-02-16 Thread Ted Yu
Hi, Currently version 1.3.0 shows up in the JIRA as Unreleased Version. Should it be marked as Released ? Cheers

Re: Possible bookkeeping error in BaseLoadBalancer

2017-02-15 Thread Ted Yu
m looking at the master branch > though. Why would the numRegionsPerServerPerTable[newServer][tableIndex] > be > set to the existing numMaxRegionsPerTable[tableIndex]? it seems like this > should be switched to what I pasted. > > On Wed, Feb 15, 2017 at 2:58 PM, Ted Yu <yuzhih...@gma

Re: Possible bookkeeping error in BaseLoadBalancer

2017-02-15 Thread Ted Yu
In master branch, I see this: if (numRegionsPerServerPerTable[newServer][tableIndex] > numMaxRegionsPerTable[tableIndex]) { numRegionsPerServerPerTable[newServer][tableIndex] = numMaxRegionsPerTable[tableIndex]; which branch are you looking at ? Thanks On Wed, Feb 15, 2017 at

[jira] [Resolved] (HBASE-17493) TestAsyncTableGetMultiThreadedWithEagerCompaction intermittently fails due to NotServingRegionException

2017-02-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17493. Resolution: Cannot Reproduce > TestAsyncTableGetMultiThreadedWithEagerCompaction intermittently fails

Re: Seems our HBASE-1.4 build keeps failing on H13

2017-02-15 Thread Ted Yu
Please file an INFRA issue. > On Feb 15, 2017, at 12:33 AM, 张铎(Duo Zhang) wrote: > > https://builds.apache.org/job/HBase-1.4/629/jdk=JDK_1_8,label=Hadoop/console > > + echo 'Listing of other java processes on this box' > Listing of other java processes on this box > +

[jira] [Created] (HBASE-17649) REST API for scan should return 410 when table is disabled

2017-02-14 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17649: -- Summary: REST API for scan should return 410 when table is disabled Key: HBASE-17649 URL: https://issues.apache.org/jira/browse/HBASE-17649 Project: HBase Issue Type

[jira] [Reopened] (HBASE-17460) enable_table_replication can not perform cyclic replication of a table

2017-02-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-17460: > enable_table_replication can not perform cyclic replication of a ta

[jira] [Created] (HBASE-17628) Local mode of mini cluster shouldn't use hdfs

2017-02-10 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17628: -- Summary: Local mode of mini cluster shouldn't use hdfs Key: HBASE-17628 URL: https://issues.apache.org/jira/browse/HBASE-17628 Project: HBase Issue Type: Test

Re: HBase DevAPI question

2017-02-10 Thread Ted Yu
Which dev API(s) in particular are you looking at ? hbase-spark module currently depends on hbase-server module (since LoadIncrementalHFiles is in hbase-server module). For the time being, add dependency of hbase-server to your sbt On Fri, Feb 10, 2017 at 1:32 PM, Lopez Sandoval, Everardo <

Re: [DISCUSSION] Upgrading core dependencies

2017-02-07 Thread Ted Yu
bq. Better to start using the new API's available in Java 8 +1 to the above. If no new Guava construct is introduced and we replace current Guava usage with Java 8 counterpart(s), in the future we can get rid of Guava dependency. On Tue, Feb 7, 2017 at 6:50 PM, Nick Dimiduk

[jira] [Resolved] (HBASE-17565) StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum

2017-02-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17565. Resolution: Fixed > StochasticLoadBalancer may incorrectly skip balancing due to skewed > multipli

<    1   2   3   4   5   6   7   8   9   10   >