Re: Planning for HBase 1.2

2015-05-29 Thread Ted Yu
+1 for Sean to be RM from me too. On Fri, May 29, 2015 at 12:28 PM, Enis Söztutar wrote: > Belated +1 for Sean for the 1.2 RM. It will be good for having diversity > for RMs. > > Enis > > On Fri, May 29, 2015 at 7:59 AM, Sean Busbey wrote: > > > It sounds like we have plenty to get into a 1.2 r

Re: Spinning 1.1.1 RC0 on Monday (June 8)

2015-06-01 Thread Ted Yu
Nick: Do you think HBASE-13356 has a chance to make this release ? Cheers On Mon, Jun 1, 2015 at 10:19 AM, Nick Dimiduk wrote: > Greetings devs, > > It's getting to be that time: I plan to spin the first 1.1.1 RC on Monday. > Remember, this is a patch release in accordance with the semantic ver

Re: Brief Explanation of HBase Connection/Security ansd help with java connection to remote Hbase

2015-06-04 Thread Ted Yu
I assume you have read http://hbase.apache.org/book.html#_client_side_configuration_for_secure_operation http://hbase.apache.org/book.html#hbase.secure.simpleconfiguration Do you run external zookeeper quorum ? See: http://hbase.apache.org/book.html#_external_zookeeper_configuration Which hbase

Re: [VOTE] The 2nd HBase 0.98.13 release candidate (RC1) is available, vote closing 6/10/2015

2015-06-09 Thread Ted Yu
+1 checked signatures ran unit test and discovered: HBASE-13854 TestTableLockManager#testLockTimeoutException fails in 0.98 and 1.0 branches which is test issue. I marked Fix Version as 0.98.14 exercised basic shell commands. Cheers On Thu, Jun 4, 2015 at 6:01 AM, Andrew Purtell wrote: > Th

Re: [VOTE] The 3rd HBase 0.98.13 release candidate (RC2) is available, vote closing 6/18/2015

2015-06-13 Thread Ted Yu
+1 Ran through test suite (against hadoop-2.0 porfile) which passed Checked signatures Practiced basic shell commands On Thu, Jun 11, 2015 at 12:44 PM, Andrew Purtell wrote: > ​The 3rd HBase 0.98.13 release candidate (RC2) is available for > download at http://people.apache.org/~apurtell/0.

Re: [VOTE] First release candidate for HBase 1.1.1 (RC0) is available

2015-06-24 Thread Ted Yu
+1 Ran test suite against Java 1.8.0_45 Checked signature Practiced basic shell commands On Tue, Jun 23, 2015 at 4:25 PM, Nick Dimiduk wrote: > I'm happy to announce the first release candidate of HBase 1.1.1 > (HBase-1.1.1RC0) is available for download at > https://dist.apache.org/repos/dist/d

Re: Github PRs

2015-06-24 Thread Ted Yu
+1 on what Sean said. On Wed, Jun 24, 2015 at 12:45 PM, Sean Busbey wrote: > So for now comments on each pointing folks to the contributor guide and > jira would work, right? > > On Wed, Jun 24, 2015 at 2:09 PM, Andrew Purtell > wrote: > > > I don't think we should accept PRs until we've discus

Re: ApacheCON EU HBase Track Submissions

2015-06-26 Thread Ted Yu
The CFP ends on July 10th for Big Data EU. See: http://events.linuxfoundation.org/events/apache-big-data-europe/program/cfp Cheers On Thu, Jun 25, 2015 at 11:29 AM, Nick Dimiduk wrote: > Hello developers, users, speakers, > > As part of ApacheCON's inaugural "Apache: Big Data", I'm hoping to se

Re: [ANNOUNCE] New HBase committer Mikhail Antonov

2015-06-30 Thread Ted Yu
Congratulations, Mikhail. On Tue, Jun 30, 2015 at 5:18 PM, Andrey Stepachev wrote: > Congrats Mikhail! :) > > On Wed, Jul 1, 2015 at 1:15 AM Andrew Purtell wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Mikhail > > Antonov has accepted the PMC's invitation to beco

Re: [ANNOUNCE] New HBase committer Esteban Gutierrez

2015-06-30 Thread Ted Yu
Congratulations, Esteban. On Tue, Jun 30, 2015 at 5:19 PM, Andrey Stepachev wrote: > Well done Esteban! > > On Wed, Jul 1, 2015 at 1:15 AM Andrew Purtell wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Esteban > > Gutierrez has accepted the PMC's invitation to beco

Re: [DISCUSS] Requesting releases from our upstream dependencies

2015-07-01 Thread Ted Yu
+1 On Wed, Jul 1, 2015 at 4:53 PM, Nick Dimiduk wrote: > This strikes me as a reasonable (and, err, surprising-that-it's-necissary) > request. +1 > > On Wed, Jul 1, 2015 at 3:46 PM, Andrew Purtell > wrote: > > > +1 > > > > > > On Wed, Jul 1, 2015 at 3:27 PM, Stack wrote: > > > > > +1 on making

Re: [DISCUSS] Hadoop versions in HBase 2.

2015-07-04 Thread Ted Yu
bq. list Hadoop 2.2 and 2.3 as not supported when HBase 2 happens Sounds good. On Sat, Jul 4, 2015 at 1:15 PM, Sean Busbey wrote: > I just noticed that the special handling for hadoop-minikdc wasn't included > in the master branch[1]. > > Before I file a follow-on, what do folks think about pla

Re: [DISCUSSION] Merge of the hbase-11339 mob branch into master.

2015-07-07 Thread Ted Yu
Looks like all MOB-related JIRAs have been resolved. Should the voting process be resumed ? Cheers On Thu, May 28, 2015 at 5:48 PM, Anoop John wrote: > Yes Andy. The sweep tool is completely optional now. We have a chore doing > the compaction, like we trigger auto major compaction. We can co

Re: [DISCUSS] Bumping Thrift to 0.9.2 in branch-1

2015-07-08 Thread Ted Yu
bq. some minor additions (new API) in 0.9.2 [5] I don't seem to find [5]. Mind sharing the link ? Thanks On Wed, Jul 8, 2015 at 11:42 AM, Srikanth Srungarapu wrote: > Hi Folks, > > Currently, HBase is using Thrift 0.9.0 version, with the latest version > being 0.9.2. Currently, the HBase Thri

Re: [VOTE] First release candidate for HBase 1.0.2 (RC0) is available. Please vote by July 14 2015

2015-07-08 Thread Ted Yu
I downloaded source for RC0 TestShell passed. Running it again just to confirm. FYI On Wed, Jul 8, 2015 at 11:57 AM, Enis Söztutar wrote: > Thanks JM. > > In the jenkins run for the RC, there is only 1 failure, and it is > TestShell: > > > https://builds.apache.org/view/All/job/HBase-1.0.2RC0/

Re: [DISCUSS] Distributed Log Replay in branch-1

2015-07-08 Thread Ted Yu
bq. set up at least Jenkins based integration tests that exercise the code paths +1 On Wed, Jul 8, 2015 at 5:45 PM, Andrew Purtell wrote: > I think we should leave it enabled in master and set up at least Jenkins > based integration tests that exercise the code paths. Otherwise, we might > be b

Re: Hbase batch get and SocketTimeoutException

2015-07-09 Thread Ted Yu
Looks like server side was not able to process all the Get's fast enough. Which release of hbase are you using ? Did you adjust any config parameters for hbase ? Thanks On Thu, Jul 9, 2015 at 12:22 AM, psobolewski wrote: > I use java and i want to do batch get like this > > final List get

Re: [VOTE] First release candidate for HBase 1.0.2 (RC0) is available. Please vote by July 14 2015

2015-07-09 Thread Ted Yu
> > Tried 10 times to run the test suite with JDK 1.7 => Failed. > > > Tried 5 times to run the test suite with JDK 1.8 => Failed. > > > RAT => Failed > > > Started locally with JDK 1.8, checked the logs, HBCK => Passed. > > > Tried create tabl

Re: [DISCUSSION] Merge of the hbase-11339 mob branch into master.

2015-07-14 Thread Ted Yu
king it a Vote thread. > > -Anoop- > > On Wed, Jul 8, 2015 at 9:46 AM, ramkrishna vasudevan < > ramkrishna.s.vasude...@gmail.com> wrote: > > > +1 to start the voting again. > > > > On Wed, Jul 8, 2015 at 9:07 AM, Ted Yu wrote: > > > > > Looks

Re: [DISCUSSION] Merge of the hbase-11339 mob branch into master.

2015-07-16 Thread Ted Yu
gt; > > Start a vote thread? This says DISCUSSION > > > > > > On Tue, Jul 14, 2015 at 2:05 PM, Ted Yu wrote: > > > > > > > There have been several iterations since the first mega patch was > > posted. > > > > > > > > Cur

Re: [VOTE] Merge branch hbase-11339 HBase MOB to trunk

2015-07-17 Thread Ted Yu
QA run for HBASE-11339 is green. IntegrationTestIngestWithMOB has been run which passes. +1 on merging to master branch. On Fri, Jul 17, 2015 at 2:01 AM, Jingcheng Du wrote: > Hi all, > > The Moderate Object Storage (MOB) feature (HBASE-11339

Re: Hbase Fully distribution mode - Cannot resolve regionserver hostname

2015-07-17 Thread Ted Yu
Have you looked at HBASE-12954 Ability impaired using HBase on multihomed hosts Cheers On Fri, Jul 17, 2015 at 3:32 AM, Pubudu Gunatilaka wrote: > Hi Devs, > > I am trying to run Hbase in fully distributed mode. So first I started > master node. Then I started regionserver. But I am getting fol

Re: Please welcome our newest committer, Nick Dimiduk

2013-09-10 Thread Ted Yu
Congratulations, Nick. On Tue, Sep 10, 2013 at 3:54 PM, Enis Söztutar wrote: > Hi, > > Please join me in welcoming Nick as our new addition to the list of > committers. Nick is exceptionally good with user-facing issues, and has > done major contributions in mapreduce related areas, hive suppor

Re: Hadoop QA build issues with HBASE-9328

2013-09-11 Thread Ted Yu
Compiling locally, I got: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project hbase-server: Compilation failure [ERROR] /Users/tyu/trunk/hbase-server/target/generated-sources/java/org/apache/hadoop/hbase/generated/master/table_js

Re: Documenting Guidance on compression and codecs

2013-09-11 Thread Ted Yu
w.r.t. Data Block Encoding, you can find some data here: https://issues.apache.org/jira/browse/HBASE-4218?focusedCommentId=13123337&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13123337 On Wed, Sep 11, 2013 at 12:10 PM, Nick Dimiduk wrote: > Do we have a consol

removing 0.95 Jenkins builds

2013-09-13 Thread Ted Yu
Hi, 0.96 release is coming soon. Should 0.95 Jenkins builds be removed ? https://builds.apache.org/job/HBase-0.95/ https://builds.apache.org/job/hbase-0.95-on-hadoop2/ Cheers

Re: Anyone to look at HBASE-9346? (OEM)

2013-09-13 Thread Ted Yu
HBASE-9346-v4-trunk.patch couldn't be applied to trunk. Can you rebase ? Thanks On Fri, Sep 13, 2013 at 6:16 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Thanks, > > JM >

Re: Hbase in embedded mode

2013-09-19 Thread Ted Yu
See 2.2.1 in http://hbase.apache.org/book.html#standalone_dist On Sep 19, 2013, at 6:49 AM, "samar.opensource" wrote: > Hi Guys, >Can we use HBase in a embedded more. So whole HBase should start in the > same JVM and there should no RPC calls. Something like our embedded java dbs. > > Do

Re: https://issues.apache.org/jira down :(

2013-09-22 Thread Ted Yu
Interesting - looks like Jenkins was able to post to JIRA. I just got notification from Hudson on HBASE-9607. Cheers On Sun, Sep 22, 2013 at 5:45 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Not working at 8h45 EST. > > Getting many issues/errors to crawl the JIRAs and download a

Re: https://issues.apache.org/jira down :(

2013-09-22 Thread Ted Yu
elfs, but it's VERY slow (and > maybe in my cache)... But attachments are still failing... > > Should we report that to someone? > > > 2013/9/22 Ted Yu > > > Interesting - looks like Jenkins was able to post to JIRA. > > I just got notification from Hudson on HB

Re: Documenting Guidance on compression and codecs

2013-09-24 Thread Ted Yu
According to http://pokecraft.first-world.info/wiki/Quick_Benchmark:_Gzip_vs_Bzip2_vs_LZMA_vs_XZ_vs_LZ4_vs_LZO, LZ4 is faster than LZOP but consumes much more memory. Cheers On Wed, Sep 18, 2013 at 8:34 PM, lars hofhansl wrote: > Do you have any numbers on compression speed, too? > I continue

Re: Class 'ArcanistDifferentialRevisionRef' not found in arc diff

2013-10-08 Thread Ted Yu
Did you encounter this issue when submitting D13341 for review ? I received that review request. Cheers On Tue, Oct 8, 2013 at 12:31 AM, liushaohui wrote: > hi all: > > I was trying to do: arc diff --update to update svn diff for review and > got : > > PHP Fatal error: Class '**ArcanistDiff

Re: LoadTestTool and PerformanceEvaluation not working from Hbase installation

2013-10-08 Thread Ted Yu
Can you give us the whole stack trace ? What command did you use ? Thanks On Tue, Oct 8, 2013 at 10:10 AM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Hi > I downloaded the trunk code.. Compiled the code.. > Trying to run LoadTestTool and PerfEvlautionTool. I get > Class

Re: LoadTestTool and PerformanceEvaluation not working from Hbase installation

2013-10-08 Thread Ted Yu
t; at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:247) > Could not find the main class: > org.apache.hadoop.hbase.PerformanceEvaluation. Program will exit. > > This is the way I had been using

NullPointerException building HBase assembly

2013-10-08 Thread Ted Yu
Hi, Under 0.96 workspace, I issued the following commands: ./dev-support/generate-hadoopX-poms.sh 0.96.0 0.96.0-hadoop2 mvn clean install -DskipTests -f pom.xml.hadoop2 mvn install assembly:single -f pom.xml.hadoop2 -DskipTests -Dmaven.javadoc.skip=true -Dhadoop.profile=2.0 -X I got the follow

Re: Default hadoop version for 0.94?

2013-10-09 Thread Ted Yu
+1 on making hadoop 1.2.1 the default. On Wed, Oct 9, 2013 at 4:01 PM, lars hofhansl wrote: > Should we default the HBase 0.94 builds to Hadoop 1.2.x (1.2.1 currently)? > It's the current stable release of the Hadoop. Can't even download 1.0.4 > anymore unless you navigate to the archive sectio

Re: HEADSUP: Working on new 0.96.0RC

2013-10-11 Thread Ted Yu
Can you provide some detail about the test failure ? I ran test suite for trunk on hadoop 2.2 and didn't see such failure. Cheers On Fri, Oct 11, 2013 at 2:03 PM, Stack wrote: > Anyone tried the 2.2 hadoop that is up for vote at the moment? I tried our > unit tests and got these failures: >

Re: skipKVsNewerThanReadpoint in StoreFileScanner and MemStoreScanner

2013-10-11 Thread Ted Yu
MultiVersionConsistencyControl.getThreadReadPoint() retrieves value from a ThreadLocal. Can you specify which operation becomes expensive ? BTW I only found IsolationLevel.READ_UNCOMMITTED in TestRowProcessorEndpoint. Looks like it is not normally used. On Fri, Oct 11, 2013 at 2:20 PM, Vladimir

location of MiniZooKeeperCluster

2013-10-11 Thread Ted Yu
Hi, I was looking at MiniZooKeeperCluster which is in hbase-server module. Here is the javadoc for this class: /** * TODO: Most of the code in this class is ripped from ZooKeeper tests. Instead * of redoing it, we should contribute updates to their code which let us more * easily access test

Re: Default hadoop version for 0.94?

2013-10-17 Thread Ted Yu
bq. Will that make anything faster to have 1.2 as the default version instead of 1.0? You can get to release notes from this thread: http://search-hadoop.com/m/pFao2kKHDm1 A few examples: MAPREDUCE-5368 . Major improvement reported by zhaoyu

Re: [VOTE] The 6th hbase-0.96.0 release candidate is available for download

2013-10-17 Thread Ted Yu
+1 I did the following on a single node cluster which runs HBase against hadoop-2: Checked out layouts for artifacts Ran TestAcidGuarantees Performed several commands using HBase shell Ran rowcounter on a small table and verified the result through shell 'count' command. All was good. On Tue, O

Re: Default hadoop version for 0.94?

2013-10-17 Thread Ted Yu
to > still build and work with 1.0.3 and 1.1.x. Maybe we should create jenkins > build for those? > > > On Thu, Oct 17, 2013 at 3:39 PM, Jean-Marc Spaggiari < > jean-m...@spaggiari.org> wrote: > > > Excellent. Thanks Ted. > > > > > > 2013/10/17 Te

Thread local readpoint would be dropped from MultiVersionConsistencyControl

2013-10-19 Thread Ted Yu
Hi, In HBASE-9754 , there is refactoring which drops perThreadReadPoint from MultiVersionConsistencyControl. There're two reasons for this: 1. Using ThreadLocal in hot path affects performance 2. The readpoint is passed from RegionScannerImpl to various Scanner classes. This can be done through pas

Re: Beware of PREFIX_TREE block encoding

2013-10-19 Thread Ted Yu
Interesting. >From this graph (HBASE-4676), PREFIX_TREE block encoding is not sensitive to variation in block size: https://issues.apache.org/jira/secure/attachment/12500778/SeeksPerSec%20by%20blockSize.png What was your block size ? If you don't bypass StoreScanner/KeyValueHeap, would that make

Re: Someone to look at HBASE-9543?

2013-10-21 Thread Ted Yu
Will take a look when I get to office. One question: was there particular reason for review request to be posted on reviews.facebook.net ? If I am not mistaken, this is for Apache trunk, right ? Most people post on reviews.apache.org Cheers On Mon, Oct 21, 2013 at 6:50 AM, Jean-Marc Spaggiari

dynamic discovery of port for UI

2013-10-22 Thread Ted Yu
Hi, In hbase-common/src/main/resources/hbase-default.xml , there is the following: hbase.regionserver.info.port.auto false Whether or not the Master or RegionServer UI should search for a port to bind to. Enables automatic port search if hbase.regionserver.info.port is alrea

Re: dynamic discovery of port for UI

2013-10-22 Thread Ted Yu
) { ServerInfo info = ProtobufUtil.getServerInfo(admin); The above is not amenable for user to call. Cheers On Tue, Oct 22, 2013 at 10:31 AM, Ted Yu wrote: > Hi, > In hbase-common/src/main/resources/hbase-default.xml , there is the > following: > > > hbase.regionser

Re: Someone to look at HBASE-9543?

2013-10-22 Thread Ted Yu
ooking at it. > > JM > > > 2013/10/21 Ted Yu > > > Will take a look when I get to office. > > > > One question: was there particular reason for review request to be posted > > on reviews.facebook.net ? > > If I am not mistaken, this is for Apac

Re: HConnectionImplementation.listTables and list table exception

2013-10-23 Thread Ted Yu
What version of HBase and Hadoop are you using ? Can you show us more of the master log ? Thanks On Oct 22, 2013, at 10:46 PM, 张莉苹 wrote: > Dear HBase dev and users, > > Did you meet this > "org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.listTables" > issue? > >

Re: HConnectionImplementation.listTables and list table exception

2013-10-23 Thread Ted Yu
bq. our hbase version was 0.94.0 and hadoop version was 1.0.3 If possible, consider upgrading HBase to 0.94.12 and Hadoop to 1.2.1 Cheers On Wed, Oct 23, 2013 at 7:18 AM, 张莉苹 wrote: > Hello Ted, and Julian, > > It seemed I didn't receive your mail from my gmail inbox. It was strange. > Anyhow

Re: HConnectionImplementation.listTables and list table exception

2013-10-23 Thread Ted Yu
The blog Julian mentioned referred to HBASE-7101 That JIRA was marked dup of HBASE-7551 which was resolved in 0.94.5 This is why upgrading HBase is desired. On Wed, Oct 23, 2013 at 10:10 AM, Ted Yu wrote: > bq. our hbase version was 0.94.0 and hadoop version was 1.0.3 > > If

Re: Do we want HBASE-9820?

2013-10-24 Thread Ted Yu
In hbase-common/src/main/resources/hbase-default.xml, we already have: hbase.master.logcleaner.plugins org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner If downstream project propagates default HBase configuration resources correctly, the change shouldn't be needed, right ? On

Re: Do we want HBASE-9820?

2013-10-24 Thread Ted Yu
< jean-m...@spaggiari.org> wrote: > Exact. But if anyone change that, typo, or anything, we will fail. So a > simple fix can avoid that. I'm not saying it's 100% required, but it's a > nice safety valve? > > > 2013/10/24 Ted Yu > > > In hbase

Re: DISCUSSION: Move to GIT?

2013-10-25 Thread Ted Yu
+1 too. On Fri, Oct 25, 2013 at 10:07 AM, Jesse Yates wrote: > +1 > > Do all my work in git anyways :) > > On Friday, October 25, 2013, Stack wrote: > > > At yesterday's dev meetup -- minutes to follow -- it was suggested we > move > > the project to git as our repo of truth. > > > > What do fol

Re: DISCUSSION: Move to GIT?

2013-10-25 Thread Ted Yu
aight line rebased >>>> commits per release branch, branches off trunk for major features) >> after >>>> the move to git as opposed to the github style (lots of branch/merges). >>>> >>>> Jon. >>>> >>>> >>>>

Re: [VOTE] The 1st hbase 0.94.13 release candidate is available for download

2013-10-30 Thread Ted Yu
+1 - checked the documentation - ran unit test suite with secure profile - built Phoenix with 0.94.13 On Wed, Oct 30, 2013 at 10:05 AM, lars hofhansl wrote: > +1 > > - checked the tarball > - checked the documentation > - created a table, inserted 100's on millions of KVs, scanned, flushed, >

Fwd: CFP NoSQL FOSDEM - Hadoop Community

2013-11-04 Thread Ted Yu
-- Forwarded message -- From: laura.czajkow...@gmail.com Date: Mon, Nov 4, 2013 at 1:29 PM Subject: CFP NoSQL FOSDEM - Hadoop Community To: u...@hadoop.apache.org Hi all, We're pleased to announce the call for participation for the NoSQL devroom, returning after a great last yea

Re: Region Server is starting normally even if clock skew is more than default 30 seconds(or any configured). -> Regionserver node time is greater than master node time

2013-11-06 Thread Ted Yu
Nice finding. Cheers On Nov 6, 2013, at 6:11 AM, Kashif Jawed Siddiqui wrote: > Hi, > > > >When Region server's time is ahead of Master's time and the difference is > more than hbase.master.maxclockskew value, region server startup is not > failing with ClockOutOfSyncException. > >

Re: [VOTE] The 1st hbase 0.94.13 release candidate is available for download

2013-11-07 Thread Ted Yu
a look. > >> I know testing a release is like pulling teeth (I think I said this > >> before). > >> > >> -- Lars > >> > >> > >> > >> > >> From: Ted Yu > >> To: "dev@hbase.apache.

Re: how long the Hadoop-QA result is kept available?

2013-11-07 Thread Ted Yu
>From https://builds.apache.org/job/PreCommit-HBASE-Build/ , you can see that results from the last 15 QA runs were kept. There are many patches submitted everyday. Each QA result would be kept shorter than 24 hours. If you're investigating javadoc / findbugs warnings, you can find the respective

Re: how long the Hadoop-QA result is kept available?

2013-11-07 Thread Ted Yu
Ni wrote: > Ted, thank you so much for the tips. It helps me to save a lot of time and > avoid to overuse the system. Appreciate it. ... Demai > > > On Thu, Nov 7, 2013 at 8:57 AM, Ted Yu wrote: > > > From https://builds.apache.org/job/PreCommit-HBASE-Build/ , you can see &

Re: Calling o/s.flush() in HLog.sync()?

2013-11-07 Thread Ted Yu
Himanshu: See http://grepcode.com/file/repository.grepcode.com/java/root/jdk/openjdk/6-b14/java/io/DataOutputStream.java#DataOutputStream.flush%28%29 The flush() call results in OutputStream.flush(). Cheers On Mon, Nov 4, 2013 at 9:11 PM, Himanshu Vashishtha wrote: > Looking at ProtobufLogWrite

Re: how long the Hadoop-QA result is kept available?

2013-11-07 Thread Ted Yu
locally, which didn't encounter additional > javadoc warning. > > > Thanks for your help in advance. > > Demai > > > On Thu, Nov 7, 2013 at 10:52 AM, Demai Ni wrote: > > > Ted, yeah. I think the -1 core test may be unrelated. > > > > also just saw tha

Re: how long the Hadoop-QA result is kept available?

2013-11-07 Thread Ted Yu
Demai: I logged HBASE-9916 for the extra warning. It was not caused by your patch. On Thu, Nov 7, 2013 at 3:25 PM, Ted Yu wrote: > Here is the link to patchJavadocWarnings.txt > > https://builds.apache.org/job/PreCommit-HBASE-Build/7779/artifact/trunk/patchprocess/patchJavadocWar

Re: problems with theUnsafe

2013-11-09 Thread Ted Yu
bq. The IBM JRE supplies Unsafe, but apparently it doesn't work Can you give us a bit more detail (in this case, UnsafeComparer) ? Is there a BUG associated with it ? If there is a known procedure / test by which we can tell whether UnsafeComparer works or not, that would help make the decision o

Re: Hbase - RegionServers used

2013-11-11 Thread Ted Yu
Take a look at http://hbase.apache.org/book.html#disable.splitting Cheers On Mon, Nov 11, 2013 at 5:54 AM, Andrea Gandini wrote: > Good morning, > > I'm a student in computer science and I'm trying to use Hbase above an HDFS > to show some performance of the system. I'd like to know how works

Re: Hadoop version trunk dependency?

2013-11-11 Thread Ted Yu
+1 on making hadoop-2 default for 0.98 On Mon, Nov 11, 2013 at 1:07 PM, Enis Söztutar wrote: > +1 on changing the default to be hadoop-2 for 0.98. > > I am not so sure about dropping support for hadoop-1 this early. We do not > want Hbase users stuck on earlier HBase versions, because they cann

Re: jars in HBase 0.96

2013-11-12 Thread Ted Yu
I think the following dependencies are pulled in from hadoop-mapreduce-client-core 2.2 See the following snippet from dependency tree: [INFO] +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0:compile [INFO] | +- org.apache.hadoop:hadoop-yarn-common:jar:2.2.0:compile [INFO] | | +- org

Re: jars in HBase 0.96

2013-11-13 Thread Ted Yu
There was a JIRA already: HADOOP-9991 FYI On Tue, Nov 12, 2013 at 8:22 PM, Ted Yu wrote: > I think the following dependencies are pulled in > from hadoop-mapreduce-client-core 2.2 > > See the following snippet from dependency tree: > > [INFO] +- org.apache.hadoop:hadoo

Re: 0.96.0: Anyone tried disable_all and drop_all?

2013-11-13 Thread Ted Yu
Have you tried (with the dot): drop_all '.*' On Wed, Nov 13, 2013 at 6:19 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > I tried those 2 commands from the shell and here is the result: > > hbase(main):007:0> drop_all '*' > IntegrationTestBigLinkedList > > dns > > > > > > page > > p

Re: 0.96.0: Anyone tried disable_all and drop_all?

2013-11-13 Thread Ted Yu
;. > > But then it should not have shown me any list of tables when I used '*'? > > I should have got something like; > hbase(main):056:0> drop_all '*' > No tables matched the regex (?-mix:^*$) > > no? > > > 2013/11/13 Ted Yu > > > Ha

Re: 0.94.14RC on Monday

2013-11-14 Thread Ted Yu
Lars: Can you take a look at HBASE-9830 ? Thanks On Thu, Nov 14, 2013 at 3:26 PM, lars hofhansl wrote: > I plan to do the first 0.94.14 RC on Monday. > If there's anything pressing that should go in, please let me know. > > -- Lars

Re: jars in HBase 0.96

2013-11-15 Thread Ted Yu
My patch for the following JIRA has been integrated (hadoop 2.3.0): MAPREDUCE-5624 move grizzly-test and junit dependencies to test scope FYI On Wed, Nov 13, 2013 at 11:03 AM, Ted Yu wrote: > There was a JIRA already: HADOOP-9991 > > FYI > > > On Tue, Nov 12, 2013 at 8:22

Re: Simple Java client

2013-11-18 Thread Ted Yu
10:45 PM, Liyin Tang wrote: > Hi Taraka, > FB is running a different HBase branch based 0.89 version and I am not quite > familiar with the HDP 2.0 code base. > However, Ted Yu, cc-ed in this email, is working at Hortonworks and he is > HBase committer as well. Hopefully, he m

Testing the fix for race condition between Compaction and StoreScanner.init

2013-11-20 Thread Ted Yu
As requested by Jonathan, I am posting the following approach for testing fix of HBASE-9949 : 1. Introduce config parameter for StoreScanner implementation which would be used by HStore for creating scanner 2. In TestStoreScanner, add StoreScanner implementation which extends StoreScanner and set

Re: [VOTE] The 2nd hbase 0.94.14 release candidate is available for download

2013-11-22 Thread Ted Yu
+1 based on the following: - checked the documentation - ran unit test suite with secure profile which passed using jdk 1.6 (jdk 1.7 produced a few test failures which were not regression - in a future release we may fix these test failures) - built Phoenix with 0.94.14 I can do more testing once

Re: Adding frameworks and coding for testabilitywas [Re: Testing the fix for race condition between Compaction and StoreScanner.init]

2013-11-23 Thread Ted Yu
The testing bits were taken out through 9949.addendum The above took place before Jonathan started this thread. On Sun, Nov 24, 2013 at 2:40 AM, Andrew Purtell wrote: > On Fri, Nov 22, 2013 at 12:54 PM, Stack wrote: > > > How did such a mess even get committed? > > > Shall we revert the HBASE-

Re: HBase 0.96.0 performace

2013-11-25 Thread Ted Yu
, you would get the list of JIRAs that contributed to the speedup from 0.96.0 to 0.96.1 Cheers On Tue, Nov 26, 2013 at 3:50 AM, Jerry He wrote: > Hi, Ted, and hbase experts > > Below picture is a performance comparison between hbase 0.96.0 and 0.96.1, > shared by Ted Yu in China Ha

Re: HBase 0.96.0 performace

2013-11-25 Thread Ted Yu
Jerry: Where did you obtain the picture ? If you got it from slides posted on China Hadoop Summit website, can you share the link ? Cheers On Tue, Nov 26, 2013 at 3:55 AM, Ted Yu wrote: > The picture didn't go through. > > Correction: the comparison between hbase 0.96.0 and 0

Re: HBase 0.96.0 performace

2013-11-25 Thread Ted Yu
23K > 0.96.1 52K 54K > > > On Mon, Nov 25, 2013 at 1:25 PM, Ted Yu wrote: > > > Jerry: > > Where did you obtain the picture ? > > > > If you got it from slid

Re: Branching 0.98

2013-11-28 Thread Ted Yu
Andy: Fix for HBASE-10005 was checked in. Previously the test failure was observed on Linux. I will verify the fix next week. 'HBASE-4811 Support reverse scan' has gone through 28 iterations of review. Do you think it can make it to 0.98.0 ? Cheers On Wed, Nov 27, 2013 at 2:35 PM, Andrew Purtel

Re: Testing the fix for race condition between Compaction and StoreScanner.init

2013-12-02 Thread Ted Yu
Is the proposed approach below acceptable ? Cheers On Wed, Nov 20, 2013 at 9:48 AM, Ted Yu wrote: > As requested by Jonathan, I am posting the following approach for testing > fix of HBASE-9949 : > > > 1. Introduce config parameter for StoreScanner implementation which wou

Re: Testing the fix for race condition between Compaction and StoreScanner.init

2013-12-02 Thread Ted Yu
iene issues as well (if the assert fails, I > think we leave a minicluster up?) > > Jon. > > > > > > On Mon, Dec 2, 2013 at 9:54 AM, Ted Yu wrote: > > > Is the proposed approach below acceptable ? > > > > Cheers > > > > > > On W

Extensions for patches accepted by QA bot

2013-12-02 Thread Ted Yu
During review of HBASE-10044 test-patch.sh should filter out documents by known file extensions Jesse made the suggestion that QA bot only accepts files with extensions .patch and .txt I want to get opinion from the community on this matter. Thanks

Re: Testing the fix for race condition between Compaction and StoreScanner.init

2013-12-02 Thread Ted Yu
bq. The lastest submitted trunk patch The proposal here wouldn't use minicluster. Cheers On Mon, Dec 2, 2013 at 7:31 PM, Jonathan Hsieh wrote: > On Mon, Dec 2, 2013 at 1:13 PM, Ted Yu wrote: > > > bq. Would it be possible just to have it focus on just a region/store

Re: Extensions for patches accepted by QA bot

2013-12-03 Thread Ted Yu
John wrote: > +1 for .patch, .txt, .diff > > -Anoop- > > On Tue, Dec 3, 2013 at 6:16 AM, Nick Dimiduk wrote: > > > Sounds reasonable to me. Maybe add .diff to that list? > > > > > > On Mon, Dec 2, 2013 at 4:34 PM, Ted Yu wrote: > > > > >

Re: Extensions for patches accepted by QA bot

2013-12-05 Thread Ted Yu
e kind and > understanding in accepting and evaluating community contributions :) > Running failing to apply a non-patch doesn't really hurt anything. > > > On Tue, Dec 3, 2013 at 9:51 AM, Ted Yu wrote: > > > Over in HBASE-10017, the following attachment triggered a QA

Re: Branching 0.98

2013-12-06 Thread Ted Yu
Andy: I have created the following two jobs by copying corresponding 0.96 Jenkins jobs: https://builds.apache.org/job/hbase-0.98/ https://builds.apache.org/job/hbase-0.98-hadoop2/ Feel free to configure them as you see fit. Cheers On Fri, Dec 6, 2013 at 4:41 PM, Andrew Purtell wrote: > Jenki

Re: Branching 0.98

2013-12-06 Thread Ted Yu
ing Jenkins karma? > > > On Friday, December 6, 2013, Andrew Purtell wrote: > >> Thank you very much for your assistance Ted! >> >> On Friday, December 6, 2013, Ted Yu wrote: >> >>> Andy: >>> I have created the following two jobs b

Re: Default JDK settings for Jenkins projects

2013-12-08 Thread Ted Yu
bq. I think we should be using JDK 7 or OpenJDK 7 +1 On Mon, Dec 9, 2013 at 9:27 AM, Jean-Marc Spaggiari wrote: > I agree. We should build 0.98 against JDK 7 instead of 6. JDK 6 End of > Public Updates since to February 2013. 0.98 is planned for 2014. Will be a > year after that. So I think it

Re: Default JDK settings for Jenkins projects

2013-12-08 Thread Ted Yu
There're several test failures when running 0.94 test suite using jdk 1.7 So there is some work to be done before switching to jdk 1.7 for 0.94 Cheers On Mon, Dec 9, 2013 at 9:41 AM, Jean-Marc Spaggiari wrote: > Make sens to have trunk with JDK 7 too... But I'm not sure for 0.94... It's > mai

Re: Default JDK settings for Jenkins projects

2013-12-09 Thread Ted Yu
> HBase 0.94), and we're extremely conservative due to the uptime > sensitive > > > nature of our service. > > > > > > > > > We should switch the 0.94 builds over to JDK 7. > > > Unless I hear strong/good reasons I'll do that and see what

Re: Hadoop version trunk dependency?

2013-12-09 Thread Ted Yu
ot of data in Hadoop 1 that they do not want to touch. > > -- Lars > > > > ________ > From: Ted Yu > To: "dev@hbase.apache.org" > Sent: Monday, November 11, 2013 1:13 PM > Subject: Re: Hadoop version trunk dependency? > > >

Re: We haven't had a clean hadoopqa build since 10/2/13.

2013-12-11 Thread Ted Yu
For the site build error, HBASE-9729 was logged. I do agree with Jon that no new warnings should be introduced. Currently 3 new Findbugs appear in QA reports. Cheers On Wed, Dec 11, 2013 at 7:13 AM, Jonathan Hsieh wrote: > Just a reminder --

Re: Extensions for patches accepted by QA bot

2013-12-11 Thread Ted Yu
I attached patch v2 to HBASE-10044 which would make QA bot accept the 3 extensions discussed here. Sorry for the delay - was at a conference last week. On Thu, Dec 5, 2013 at 9:10 AM, Nick Dimiduk wrote: > Thanks Ted! > > > On Thu, Dec 5, 2013 at 8:50 AM, Ted Yu wrote: &

Re: We haven't had a clean hadoopqa build since 10/2/13.

2013-12-11 Thread Ted Yu
I did a git bisect to find the > commits > > > that caused the problem and emailed the committer. > > > > > > On Wednesday, December 11, 2013, Ted Yu wrote: > > > > > > > For the site build error, > > > > HBASE-9729<https://issues.apache

Re: HBase 0.96 LogLevel?

2013-12-14 Thread Ted Yu
How did you set log level to DEBUG ? I tried the following command and it worked: hbase -Dhbase.root.logger=DEBUG,RFA org.apache.hadoop.hbase.util.CompressionTest file:///tmp/test.txt snappy Snippet of log file: 2013-12-14 15:23:37,853 DEBUG [main] hdfs.BlockReaderLocal: The short-circuit local

Re: HBase 0.96 LogLevel?

2013-12-14 Thread Ted Yu
EncodingContext.java:79) > at > > org.apache.hadoop.hbase.io.hfile.HFileBlock$Writer.(HFileBlock.java:719) > at > > org.apache.hadoop.hbase.io.hfile.HFileWriterV2.finishInit(HFileWriterV2.java:131) > at > > org.apache.hado

Re: hbase pull request: Fix for HBASE-10139

2013-12-16 Thread Ted Yu
Hi, There is initiative to move source repo to github but that is work in progress. Let's continue with the normal review process on the JIRA. Cheers On Mon, Dec 16, 2013 at 1:45 AM, sunzhu wrote: > GitHub user sunzhu opened a pull request: > > https://github.com/apache/hbase/pull/6 > >

Re: Rolling 0.94.15RC0 tomorrow.

2013-12-17 Thread Ted Yu
Looks like HBASE-10185 should be included. Cheers On Dec 16, 2013, at 10:15 PM, James Taylor wrote: > https://issues.apache.org/jira/browse/HBASE-10181 if it's easy. Would love > to get someone to look at > https://issues.apache.org/jira/browse/HBASE-3727after this point > release. > > Thanks

<    12   13   14   15   16   17   18   19   20   21   >