Re: [VOTE] Third release candidate for HBase 1.1.2 (RC2) is available

2015-08-27 Thread Ted Yu
+1 based on the following: verified signatures ran unit test suite - pass loaded onto a small cluster and performed sanity checks (hbase shell, UI, etc) Cheers On Wed, Aug 26, 2015 at 9:16 PM, Nick Dimiduk wrote: > Hello again devs, > > This "third time's the charm" edition release candidate o

Re: Optimizing LoadIncrementalHFiles.java

2015-08-27 Thread Ted Yu
At roughly how many column families would this change show performance boost ? Cheers > On Aug 27, 2015, at 4:56 PM, Himanshu Verma > wrote: > > Hi, > > I was looking at following method: > > public void doBulkLoad(Path hfofDir, final Admin admin, Table table, >> >> RegionLocator reg

Re: [VOTE] The 2nd HBase 0.98.14 release candidate (RC1) is available

2015-08-27 Thread Ted Yu
+1 built from the source ran test suite - passed exercised basic shell commands Cheers On Thu, Aug 27, 2015 at 4:03 PM, wrote: > +1 > - built from the source tag- installed with a one-node HDFS cluster > (2.4.1)- created a table, loaded 100m rows- checked an older 100m row table > that I had l

Re: Optimizing LoadIncrementalHFiles.java

2015-08-27 Thread Ted Yu
I looked at the code again. When number of HFiles to be loaded times number of column families is a big value, your suggestion may produce some speedup. If you have access to a cluster, you can measure potential savings in your approach. Cheers On Thu, Aug 27, 2015 at 5:08 PM, Ted Yu wrote

Re: Hbase Master error

2015-09-01 Thread Ted Yu
Have you checked hdfs ? Master was waiting for namenode to exit safe mode. > On Sep 1, 2015, at 9:44 AM, beeshma r wrote: > > HI > > i have issue with Hbase master > > Below is actual error > > hbase(main):001:0> list > TABLE > > SLF4J: Class path contains multiple SLF4J bindings. > SLF

Re: improvement in htable.doput

2015-09-06 Thread Ted Yu
Looking at the tip of 0.98 branch, the logic in doPut() is the same as shown below. You may want to open a JIRA and attach patch if you have time. Cheers On Sun, Sep 6, 2015 at 6:15 PM, wangyongqiang0...@163.com < wangyongqiang0...@163.com> wrote: > in hbase0.98.10, doPut is as follows: > > p

Re: Planning for HBase 2.0

2015-09-07 Thread Ted Yu
Design for the following is being finalized: HBASE-13153 enable bulkload to support replication Do you think it should be included ? Cheers On Mon, Sep 7, 2015 at 8:42 PM, Matteo Bertozzi wrote: > Hey folks, > > my list for 2.0 looks quite full, but I'm probably missing something. > > main poi

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-09-08 Thread Ted Yu
In HRegion#increment(), we lock the row (not region): try { rowLock = getRowLock(row); Can you pastebin the complete stack trace ? Thanks On Tue, Sep 8, 2015 at 2:01 AM, 鈴木俊裕 wrote: > Hi, > > We upgraded our cluster from CDH5.3.1(HBase0.98.6) to CDH5.4.5(HBase1.0.0) > and we experie

Re: Planning for HBase 2.0

2015-09-08 Thread Ted Yu
t; > HBASE-13153 seems small enough that may also be considered for a > > branch-1. > > > > > > it will take at least 3 months to have a branch-2, > > > I don't want this thread to end up pointing out all minor jiras. > > > so, my rule is: if it is

Re: NotServingRegion: hbase region closed forever when open region response time out

2015-09-10 Thread Ted Yu
Can you come up with a test that shows the problem ? Consider opening a JIRA with anonymized master log, your test and proposed solution (if you have one). Cheers On Thu, Sep 10, 2015 at 6:09 AM, zhou_shuaif...@sina.com < zhou_shuaif...@sina.com> wrote: > Hi all, > I found a situation may c

Re: JIRA contributor role

2015-09-18 Thread Ted Yu
Looks like your effort of adding Jianwei went through - I found his name in contributors' list and assigned HBASE-14443 to him. FYI On Fri, Sep 18, 2015 at 2:47 PM, Nick Dimiduk wrote: > Heya folks, > > It seems our list of contributors in JIRA is so long that I'm unable to add > anyone. The fa

Re: Branch 2 build failing?

2015-09-24 Thread Ted Yu
I think you meant master branch - branch-2 hasn't been cut yet. TestHFileBlockPositionalRead.java was added on Sept 11th. I sync'ed with master branch but didn't reproduce the compilation error. FYI On Thu, Sep 24, 2015 at 7:51 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > I have

Re: Change Zookeeper clientPort from HbaseTestingUtility

2015-09-24 Thread Ted Yu
Please see the following in HBaseTestingUtility.java : * Start a mini ZK cluster. If the property "test.hbase.zookeeper.property.clientPort" is set * the port mentionned is used as the default port for ZooKeeper. */ private MiniZooKeeperCluster startMiniZKCluster(final File dir,

Re: branch-2

2015-09-24 Thread Ted Yu
bq. remove branch-2 to avoid confusion +1 On Thu, Sep 24, 2015 at 8:51 AM, Sean Busbey wrote: > Are we breaking apart branch-2 and master now? > > If not, can we remove branch-2 to avoid confusion? > > -- > Sean >

Re: Branch 2 build failing?

2015-09-24 Thread Ted Yu
27;m testing doesn't > apply on trunk but applies on this one, so I took a chance ;) > > JM > > 2015-09-24 11:02 GMT-04:00 Ted Yu : > > > I think you meant master branch - branch-2 hasn't been cut yet. > > > > TestHFileBlockPositionalRead.java was a

Re: hbase0.98.10 open region speed

2015-09-24 Thread Ted Yu
For zookeeperless region assignment, can you try master branch for comparison ? Cheers On Thu, Sep 24, 2015 at 1:33 AM, wangyongqiang0...@163.com < wangyongqiang0...@163.com> wrote: > in hbase 0.98.10, we can set hbase to open region with or without > zookeeper. > to compare open region speed o

Re: Is it necessary to use an individual wait time for each procedure

2015-09-24 Thread Ted Yu
Looking at master branch: this.operationTimeout = this.conf.getInt(HConstants. HBASE_CLIENT_OPERATION_TIMEOUT, HConstants.DEFAULT_HBASE_CLIENT_OPERATION_TIMEOUT); If I read code correctly, HBaseAdmin.execProcedure() uses the above. Which procedure were you checking ? Cheers On Thu

Re: master shell break? - LoadError: no such file to load -- shell/commands/compact_mob

2015-09-28 Thread Ted Yu
Failed test in hbase-server prevented tests in hbase-shell module to run. Locally I can reproduce: http://pastebin.com/228jgfSM FYI On Mon, Sep 28, 2015 at 12:53 PM, Andrew Purtell wrote: > TestShell didn't pick this up looks like. How I wonder. > > > > On Sep 28, 2015, at 11:00 AM, Stephen J

Re: master shell break? - LoadError: no such file to load -- shell/commands/compact_mob

2015-09-28 Thread Ted Yu
Thanks Esteban for the quick turnaround. On Mon, Sep 28, 2015 at 2:27 PM, Esteban Gutierrez wrote: > we should be good now. > > -- > Cloudera, Inc. > > > On Mon, Sep 28, 2015 at 12:59 PM, Andrew Purtell > > wrote: > > > Thanks Ted. > > > > >

Re: [VOTE] The 1st HBase 0.98.15 release candidate (RC0) is available

2015-10-05 Thread Ted Yu
+1 Checked signatures Ran unit test suite against hadoop-1, found HBASE-14553 (to be fixed in 0.98.16) Exercised basic shell commands On Fri, Oct 2, 2015 at 7:20 PM, Andrew Purtell wrote: > The 1st HBase 0.98.15 release candidate (RC0) is available for download at > http://people.apache.org/~ap

Re: simplify defaultLoadBalancer log

2015-10-10 Thread Ted Yu
Here are the LoadBalancer classes in 0.98 branch: /Users/tyu/98//hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java /Users/tyu/98//hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/FavoredNodeLoadBalancer.java /Users/tyu/98//hbase-server/src/m

Re: Re: simplify defaultLoadBalancer log

2015-10-10 Thread Ted Yu
hing to balance, then don't say anything unless > trace-level logging. > LOG.trace("Skipping load balancing because balanced cluster; " + > "servers=" + cs.getNumServers() + " " + > "regions=" + cs.getNumRegions() + "

Re: add a task in master to check if tableInfo is missinig

2015-10-16 Thread Ted Yu
Are you running hbase on secure cluster ? As J-M said, hbck can come to the rescue if you encounter such a case. Cheers On Fri, Oct 16, 2015 at 10:11 AM, wangyongqiang0...@163.com < wangyongqiang0...@163.com> wrote: > > if we delete the tableInfo file by mistake, then if hbase is restated, the

Re: add a task in master to check if tableInfo is missinig

2015-10-16 Thread Ted Yu
dfs > > > > wangyongqiang0...@163.com > > From: Ted Yu > Date: 2015-10-17 01:17 > To: dev@hbase.apache.org > Subject: Re: add a task in master to check if tableInfo is missinig > Are you running hbase on secure cluster ? > > As J-M said, hbck can come to the

Re: add msg in disable table interface

2015-10-22 Thread Ted Yu
Isn't such information already available in master log (though not on one line) ? bq. a process need to add cp so disable Using online table alter feature, there is no need to disable the whole table. Cheers On Thu, Oct 22, 2015 at 3:07 AM, wangyongqiang0...@163.com < wangyongqiang0...@163.com>

Re: HBase 1.2.0 RC status

2015-10-24 Thread Ted Yu
For multi-wal, some JIRAs (such as HBASE-6617) were only integrated to branch-1 and master branch. Once those JIRAs are backported, issue #1 should be resolved. FYI On Sat, Oct 24, 2015 at 10:09 AM, Elliott Clark wrote: > IT tests on a real cluster are completely green. So that's promising. >

Re: remove accidental branch1.2?

2015-10-26 Thread Ted Yu
+1 on removing branch1.2 Don't know why some of my JIRAs showed up in the following list. I verified that they were integrated into branch-1.2 Cheers On Mon, Oct 26, 2015 at 5:10 PM, Enis Söztutar wrote: > Seems that we have branch1.2 pushed (as opposed to branch-1.2). Probably a > typo. > > I

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2015-10-28 Thread Ted Yu
bq. I'll volunteer to RM 1.3 +1 On Wed, Oct 28, 2015 at 2:07 PM, Andrew Purtell wrote: > I haven't heard an user answer in the affirmative to wanting it. > > I'll volunteer to RM 1.3, whenever we need it. Premature to have that > discussion without 1.2 even out the door yet, though. > > > > On

Re: HBase 1.2.0 RC status

2015-10-30 Thread Ted Yu
ott, Ted, > > Can y'all make sure there are appropriate jiras to track these? the > post-commit builds are getting close (now passing 3 out of last 4), > and I don't see them represented in the current blockers? > > On Sat, Oct 24, 2015 at 5:49 PM, Ted Yu wrote: > &g

Re: Balancer not running for a long time.

2015-10-30 Thread Ted Yu
bq. there are no logs to record why we not running balancer Here was the reason: bq. Not running balancer because 3 region(s) in transition: bq. Could we just balance regions not in transition? Yes. Please take a look at HBASE-14309 Cheers On Fri, Oct 30, 2015 at 7:19 PM, Heng Chen wrote: >

Re: Balancer not running for a long time.

2015-10-30 Thread Ted Yu
eah, but balancer runs every 5 minutes, 3 region(s) in transition log > > only show up only in a few places > > > > 2015-10-31 10:23 GMT+08:00 Ted Yu : > > > >> bq. there are no logs to record why we not running balancer > >> > >> Here was

Re: Planning to imminently run 1.0.3 and 1.1.3 release candidates along with 0.98.16

2015-11-04 Thread Ted Yu
bq. retiring 1.0 branch and releases I would vote for the retirement of 1.0 release. Cheers On Wed, Nov 4, 2015 at 11:09 AM, Enis Söztutar wrote: > Related, I was waiting on 1.2.0 RC to start the discussion, but we can do > it now. > > How do you guys feel about retiring 1.0 branch and releas

Re: improvements on snapshot

2015-11-07 Thread Ted Yu
For #1, I took a look at current 0.98 code but didn't find it. Can you double check and tell us the updated line number ? For #2, I think it makes sense - considering there may be large number of snapshots in the cluster. For #3, can you tell us the use case for the new API ? Cheers On Fri, Nov

Re: Re: improvements on snapshot

2015-11-07 Thread Ted Yu
t; ImmutableSet filteredFileSet = > ImmutableSet.copyOf(filteredFiles); > for (FileStatus file : deletableValidFiles) { > if (!filteredFileSet.contains(file)) { > LOG.trace(file.getPath() + " is not deletable according to:" + > cleaner); > } >

Re: Re: improvements on snapshot

2015-11-07 Thread Ted Yu
filteredFileSet.contains(file)) { > LOG.trace(file.getPath() + " is not deletable according to:" + > cleaner); > } > } > } > i think these code can use set's difference operation instead, which > is more straightforward

Re: Changing resolution in JIRA

2015-11-09 Thread Ted Yu
Lars: Resolved issues for released versions should be closed. Cheers On Mon, Nov 9, 2015 at 11:52 AM, Lars Francke wrote: > Thanks guys! > > Another related question: Resolved vs. Closed? Should all resolved issues > (especially the old ones) be closed? If so I'd be happy to work a bit on > thi

Re: Thrift versions and generated code

2015-11-12 Thread Ted Yu
See https://issues.apache.org/jira/browse/HBASE-14172 On Thu, Nov 12, 2015 at 11:46 AM, Josh Elser wrote: > Hi, > > In looking at https://issues.apache.org/jira/browse/HBASE-14800, I saw > that the current libthrift dependency on master was at 0.9.2, but the > generated code still has the 0.9.0

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Ted Yu
bq. adding in a line for 2.6.1+ similar to the 2.7.1+ line +1 We should periodically update the matrix with new hadoop releases. Cheers On Fri, Nov 13, 2015 at 7:15 AM, Sean Busbey wrote: > Heya folks, > > In response to our push the Hadoop community has been making patch releases > on the 2.

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-16 Thread Ted Yu
+1 Ran unit test suite - passed against hadoop 2.6.2 Exercised basic shell commands Cheers On Sun, Nov 15, 2015 at 8:09 PM, wrote: > +1 > > - Built from source, against Hadoop 2.4.1.- loaded some 100m rows, > compacted, etc. > - ran scan perf tests (scans, gets, puts)- nothing undue in the log

Re: Cleanup admin.rb. Shell in general.

2015-11-17 Thread Ted Yu
See this related thread: http://search-hadoop.com/m/YGbbUzRN61T6Wdm1/hbase+shell+2.0&subj=Ruby+shell+versions+for+HBase+2+0 On Tue, Nov 17, 2015 at 6:35 PM, Apekshit Sharma wrote: > (Planning to do this tomorrow as part of our weekly code fixit. Will > appreciate quick feedback.) > > Admin.rb e

Re: HBASE-14850 C++ Client Branch

2015-11-19 Thread Ted Yu
+1 on creating branch for C++ client work. On Thu, Nov 19, 2015 at 4:30 PM, Elliott Clark wrote: > C++ client is going to be a reasonable undertaking. I was thinking that a > branch for it would be best so that any new branches off of master wouldn't > be held back by half done implementations.

Re: [VOTE] The 1st HBase 0.98.16.1 patch release candidate (RC0) is available

2015-11-21 Thread Ted Yu
+1 Checked signatures Ran test suite against hadoop 2.6.2 - passed (see below for summary) Exercised basic shell commands Cheers [INFO] Apache HBase - Assembly SUCCESS [ 2.167 s] [INFO] [INFO]

Re: Consesus on removing a public method from IA.Private class whose instance is returned from IA.public class.

2015-11-26 Thread Ted Yu
bq. we should not remove it directly My understanding is the same. Cheers On Wed, Nov 25, 2015 at 10:22 PM, ashish singhi wrote: > Hello to all. > > I know that we can safely remove any APIs from a InterfaceAudience.Private > class and the same is described in the HBase book. > > Now consider

Re: Review request

2015-11-27 Thread Ted Yu
HBASE-14523 has been integrated. The other two are close. Cheers On Fri, Nov 27, 2015 at 12:40 PM, Samir Ahmic wrote: > Hi all, > > I'm trying to do some testing around > https://issues.apache.org/jira/browse/HBASE-14749 but i'm constantly > hitting some of these issues: > > https://issues.apa

Re: Checkstyle News

2015-12-02 Thread Ted Yu
Appy: Nice work. In dev-support/test-patch.sh : mv target/site/checkstyle.css $PATCH_DIR This seems to give the following in console: Determining number of patched Checkstyle errors. == ==

Re: -1 overall but +1 in individual tests

2015-12-02 Thread Ted Yu
-1 is given if value of $RESULT is not 0 : submitJiraComment $RESULT $RESULT is summation of return values of various checks: checkAntiPatterns (( RESULT = RESULT + $? )) checkBuildWithHadoopVersions (( RESULT = RESULT + $? )) ... Looks like $RESULT was non-zeron somehow. It was not clear whic

Re: -1 overall but +1 in individual tests

2015-12-02 Thread Ted Yu
ogs anyway. > > > On Wed, Dec 2, 2015 at 7:35 PM, Ted Yu wrote: > > > -1 is given if value of $RESULT is not 0 : > > > > submitJiraComment $RESULT > > > > $RESULT is summation of return values of various checks: > > > > ch

IndentationCheck of checkstyle

2015-12-29 Thread Ted Yu
> Hi, > I noticed that there are a lot of checkstyle warnings in the following form: > > source="com.puppycrawl.tools.checkstyle. > checks.indentation.IndentationCheck"/> > > To my knowledge, we use two spaces for each tab. Not sure why all of a sudden > we have so many IndentationCheck war

Re: Checkstyle News

2015-12-30 Thread Ted Yu
Appy: In one JIRA I am working on (HBASE-15044), I tried to correct non-IndentationCheck warnings to compensate for the new IndentationCheck warnings. However, checkstyle warning still showed -1. Do you think IndentationCheck can be relaxed ? Cheers On Wed, Dec 2, 2015 at 2:46 PM, Apekshit Sharm

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.7,Hadoop #600

2015-12-30 Thread Ted Yu
HBASE-15044 didn't introduce any new file. Error involving META-INF/LICENSE.vm should be unrelated. On Wed, Dec 30, 2015 at 10:31 AM, Stack wrote: > Is there a licensing issue here -- a file missing license or some such? Let > me try rerunning the build... > > St.Ack > > On Wed, Dec 30, 2015 a

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #600

2015-12-30 Thread Ted Yu
In newer build: https://builds.apache.org/job/HBase-TRUNK_matrix/jdk=latest1.8,label=Hadoop/601/console There was no error involving META-INF/LICENSE.vm Looks like the error below was intermittent. HBASE-15044 didn't introduce any new file. On Wed, Dec 30, 2015 at 10:32 AM, Stack wrote: > See

Re: Compact after manual flush broken in 1.0+?

2015-12-31 Thread Ted Yu
bq. it looks like this is an oversight I agree. On Thu, Dec 31, 2015 at 12:04 AM, wrote: > Normally HBase triggers a compaction after a manual flush (of a region or > table). > Looks like in 1.0 and later the code is still there but not actually > exercised, because FlushTableSubprocedure calls

Re: Compact after manual flush broken in 1.0+?

2015-12-31 Thread Ted Yu
ay, December 31, 2015 6:10 AM > Subject: Re: Compact after manual flush broken in 1.0+? > > Indeed. I already informed the list about that months ago ;) > > 2015-12-31 9:09 GMT-05:00 Ted Yu : > > > bq. it looks like this is an oversight > > > > I agree. > >

Re: [VOTE] HBase 1.2.0 RC0

2016-01-04 Thread Ted Yu
+1 Ran unit test suite Exercised basic shell commands [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 01:44 h [INFO] Finished at: 2016-01-03T09:12:35-08:00 On Sun, Jan 3, 2016 at 4:29 AM, Sean Busbey wrote: > Happy New Yea

truncated checkstyle output

2016-01-05 Thread Ted Yu
Hi, I was looking at checkstyle warnings for one of my patches. I noticed that both trunkCheckstyle.xml and patchCheckstyle.xml were truncated, resulting in bad-formed xml files. I downloaded trunkCheckstyle.xml from another QA run (not for my patch) and observed truncated xml: https://builds.apac

identifying source of region split request

2016-01-05 Thread Ted Yu
Hi, I recently worked on improving region normalization feature. If region split request triggered by the execution of SplitNormalizationPlan fails, there is no way of knowing whether the failed split originated from region normalization. Such association would give RegionNormalizer information so

Re: [VOTE] HBase 1.2.0 RC0

2016-01-06 Thread Ted Yu
nging procedures in master DDL. The change is local > and > > > low risk. Discussing with Sean and Matteo privately, they agreed to > > > include them in 1.2. I will commit to branch-1.2 today so that the > next > > > 1.2RC would have the changes. >

Re: identifying source of region split request

2016-01-06 Thread Ted Yu
RSs with high failure rate > and don't attempt to split regions hosted there in future? > > On Tue, Jan 5, 2016 at 2:55 PM, Ted Yu wrote: > > > Hi, > > I recently worked on improving region normalization feature. > > > > If region split request triggered by the

Re: identifying source of region split request

2016-01-06 Thread Ted Yu
On Wed, Jan 6, 2016 at 10:23 AM, Ted Yu wrote: > > > bq. collect statistics to blacklist some RSs with high failure rate > > > > The metadata would help pinpoint the regions which consistently fail > split > > (merge) in the recent past. The failure could be due to c

Re: Parallel scanning of snapshots using hbase client api

2016-01-07 Thread Ted Yu
This seems related: HBASE-14128 FYI On Thu, Jan 7, 2016 at 9:24 AM, Deepti Bhogle wrote: > We currently do exactly that. We create multiple instances of > TableSnapshotScanner each with a unique dir location against the same > snapshot. But doing so gives us the exception mentioned. Does that

Re: Normalizer in 1.2+?

2016-01-13 Thread Ted Yu
There is RegionNormalizerTracker which tracks region normalizer state up in ZK. When user toggles normalizer switch through shell, the following method in MasterRpcServices is called: public boolean normalizerSwitch(boolean on) { boolean oldValue = master.getRegionNormalizerTracker().isNor

Re: HBase EndPoint co-Processor

2016-01-14 Thread Ted Yu
For #1, yes, you can perform Put on another region from your coprocessor. Though there is intricacy of managing handlers to avoid deadlock. For #2, do you mean whether you can scan other region(s) from the coprocessor ? Yes. Cheers On Thu, Jan 14, 2016 at 2:34 AM, Avinash Dongre wrote: > What

Re: Machine H2 in the precommit pool fails on hadoopchecks

2016-01-14 Thread Ted Yu
Suggest logging an INFRA ticket if you haven't done so. Cheers On Thu, Jan 14, 2016 at 8:59 AM, Jonathan Hsieh wrote: > Hey all, > > I've tracked an intermittent precommit build problem down when > investigating HBASE-15069 and HBASE-15104 runs – this happens on all > precommit hbase jobs that

Re: Branch for HBASE-14030, HBASE-14123 etc

2016-01-14 Thread Ted Yu
+1 On Thu, Jan 14, 2016 at 3:28 PM, Matteo Bertozzi wrote: > sounds good to me, it will be easier to look at and try out. > > > Matteo > > > On Thu, Jan 14, 2016 at 3:14 PM, Vladimir Rodionov > > wrote: > > > Hi, folks > > > > I think we have to create separate branch for backup/restore work. >

Re: Data loss after compaction when a row has more than Integer.MAX_VALUE columns

2016-01-17 Thread Ted Yu
Interesting. Can you share your use case where more than Integer.MAX_VALUE columns are needed. Consider filing a JIRA for the proposed change. On Sun, Jan 17, 2016 at 8:05 PM, Toshihiro Suzuki wrote: > Hi, > > We have lost the data in our development environment when a row has more > than Inte

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-01-19 Thread Ted Yu
Looks like 1.2.0 RC is in near future. I wonder if it is time to revive this thread (due to customer interest). As far as I can tell, the Mob related tests have been passing in the recent past. Thanks On Wed, Oct 28, 2015 at 2:07 PM, Andrew Purtell wrote: > I haven't heard an user answer in t

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-01-19 Thread Ted Yu
gt; > On Tue, Jan 19, 2016 at 4:55 PM, Andrew Purtell > wrote: > > > Pretty sure Sean expressed 1.2 is feature complete and I'd support that. > > Can we wait for 1.3 for MOB ? Can look at Spark connector then too. > > > > > On Jan 19, 2016, at 4:52 PM, Ted Yu

Re: On our builds taking a long time since move to yetus

2016-01-19 Thread Ted Yu
bq. that only checked test-compile on jdk1.7 instead of the full unit test suite. This would be sufficient for branch-1.x and master branch. Cheers On Tue, Jan 19, 2016 at 6:52 PM, Sean Busbey wrote: > Alternatively, I could attempt to turn precommit into a matrix build that > runs yetus agai

Re: HBase custom RowFilter proposition

2016-01-21 Thread Ted Yu
HBase already has the following: ./hbase-client/src/main/java/org/apache/hadoop/hbase/filter/RowFilter.java Can you illustrate how your RowFilter is different from the above ? Cheers On Thu, Jan 21, 2016 at 1:56 PM, Nicolas Fabre wrote: > Hi. > > I developed a custom HBase RowFilter for my own

Re: [VOTE] The 1st HBase 0.98.17 release candidate (RC0) is available

2016-01-22 Thread Ted Yu
+1 Ran test suite against hadoop 2.7.0 - passed Exercised basic shell commands On Wed, Jan 20, 2016 at 9:51 PM, wrote: > +1 > - build from source- loaded 100m rows- executed some custom scan, load, > and perf tests- nothing undue in the logs > > -- Lars > > From: Andrew Purtell > To: "

Re: Error:issue with zookeeper in connection to server

2016-01-22 Thread Ted Yu
Is your cluster a secure cluster ? Was there more log of zookeeper server you can share ? Thanks > On Jan 19, 2016, at 11:58 PM, Parmeet Arora wrote: > > Please help me to resolve the issue. > I am using Hadoop-2.5.0 and Hbase-1.1.0 > > 2016-01-20 13:30:57,024 INFO [NIOServerCxn.Factory:0.0

Re: [VOTE] Second release candidate for HBase 1.0.3 (RC1) is available. Please vote by Jan 26 2016

2016-01-27 Thread Ted Yu
+1 - Checked signatures - Ran unit test suite - Exercised shell commands On Wed, Jan 27, 2016 at 11:17 AM, Jonathan Hsieh wrote: > +1. (binding) > > - Compat report looks good. > - Checked signatures, looks good > - Built from source, site, docs, rat, looks good > -- ('mvn clean test site -Dsk

Re: [VOTE] HBase 1.2.0 RC1

2016-01-29 Thread Ted Yu
Compilation didn't pass on the expanded source tar ball: [ERROR] /home/hbase/hbase-1.2.0/hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/MasterProcedureQueue.java:[60,7] error: MasterProcedureQueue is not abstract and does not override abstract method poll() in Procedur

Re: [VOTE] HBase 1.2.0 RC1

2016-01-29 Thread Ted Yu
> > > On Fri, Jan 29, 2016 at 10:39 AM, Ted Yu wrote: > > > Compilation didn't pass on the expanded source tar ball: > > > > [ERROR] > > > > > /home/hbase/hbase-1.2.0/hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/MasterPro

Re: [VOTE] HBase 1.2.0 RC1

2016-01-29 Thread Ted Yu
+1 Ran test suite using Java 1.7.0_67 Exercised basic shell commands [INFO] Apache HBase - Shaded - Client . SUCCESS [ 0.493 s] [INFO] Apache HBase - Shaded - Server . SUCCESS [ 0.867 s] [INFO] -

Re: When split a region, how to get row keys efficiently instead of using midkey

2016-01-30 Thread Ted Yu
bq. get all row keys in a range Currently there is no metadata in HFile w.r.t. all row keys which appear in the HFile. As you have found out, there is no fast way of getting such information. On Fri, Jan 29, 2016 at 9:41 PM, onealbao wrote: > Hi, > > In default region split policy, it first fin

Re: [DISCUSS] Dynamic switches in master

2016-02-03 Thread Ted Yu
+1 to reducing dependency on zookeeper > On Feb 3, 2016, at 9:50 PM, 张铎 wrote: > > My opinion, use conf file as default, and use code to override the config > in conf file. > And we need to persist the overridden value somewhere, not zk I'd say. I > agree with Matteo that we should reduce the d

Re: [VOTE] HBase 1.2.0 RC2

2016-02-08 Thread Ted Yu
+1 Checked signature Ran test suite Exercised shell commands [INFO] Apache HBase - Shaded - Server . SUCCESS [ 0.911 s] [INFO] [INFO] BUILD SUCCESS [INFO] ---

Re: [VOTE] HBase 1.2.0 RC2

2016-02-12 Thread Ted Yu
If we go with shortened voting period, my assumption is that RC3 would be RC2 + fix for HBASE-15252, right ? Cheers On Thu, Feb 11, 2016 at 9:18 PM, Sean Busbey wrote: > On Thu, Feb 11, 2016 at 10:59 PM, Stack wrote: > > > On Thu, Feb 11, 2016 at 5:04 PM, Sean Busbey > > wrote: > > > > > On F

Re: [VOTE] HBase 1.2.0 RC2

2016-02-12 Thread Ted Yu
I did some validation today. See my comment at the tail of HBASE-15219. I reverted my patch until we find out which patch caused the -treatFailureAsError flag not to work. On Fri, Feb 12, 2016 at 1:22 PM, Stack wrote: > I just ran a small ITBLL against current 1.2 HEAD and it seems fine... > no

Re: [VOTE] HBase 1.2.0 RC2

2016-02-12 Thread Ted Yu
Monday is a holiday. Wednesday seems better for end of voting period. On Fri, Feb 12, 2016 at 7:41 PM, Sean Busbey wrote: > okay, I'll roll RC3 tomorrow. > > What are folks thinking on voting period? 72hrs (~tuesday)? Maybe Wednesday > for a little extra? > > On Fri, Feb 12, 2016 at 7:07 PM, St

Re: [VOTE] HBase 1.2.0 RC3

2016-02-13 Thread Ted Yu
+1 Checked signatures Ran test suite Exercised shell commands On Sat, Feb 13, 2016 at 12:20 PM, Sean Busbey wrote: > Hi Folks! > > I'm pleased to announce the next release candidate for HBase 1.2.0. > > Artifacts are available here: > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.2.0RC

Re: [VOTE] HBase 1.2.0 RC4

2016-02-19 Thread Ted Yu
+1 Checked signature Ran unit test suite Practiced basic shell commands On Thu, Feb 18, 2016 at 10:38 PM, Sean Busbey wrote: > Hi Folks! > > I'm pleased to announce the next release candidate for HBase 1.2.0. > > Artifacts are available here: > > https://dist.apache.org/repos/dist/dev/hbase/hba

Re: Create Multiple Column Family automatic

2016-02-23 Thread Ted Yu
You can add the column families to the HTableDescriptor which is passed to HBaseAdmin#createTable(HTableDescriptor) call. On Tue, Feb 23, 2016 at 8:39 AM, SaCvP125 wrote: > Is possible to create multiple column families (with the same number and > name > columns) automatically? > > > > -- > View

Re: [DISCUSS] Re: Branch for 1.3

2016-02-24 Thread Ted Yu
bq. will we also be deprecating minor releases faster? +1 On Wed, Feb 24, 2016 at 12:04 PM, Sean Busbey wrote: > On Wed, Feb 24, 2016 at 1:50 PM, Elliott Clark wrote: > > Is it time to branch for 1.3 ? > > > > Sean did a great job getting 1.2 out. However it was a hard difficult > > process t

Re: Branch for 1.3

2016-02-25 Thread Ted Yu
bq. 1.2 was cut off mid-June 2015 1.2.0 was released recently. Did you mean another release ? On Thu, Feb 25, 2016 at 12:54 PM, Mikhail Antonov wrote: > To me it's not really about individual big features (besides, big features > might be hard to accommodate in a minor release), but enough good

Re: Branch for 1.3

2016-02-25 Thread Ted Yu
There is also hbase-spark module worth considering for backport. Current active JIRA is HBASE-14801 FYI On Thu, Feb 25, 2016 at 1:25 PM, Enis Söztutar wrote: > Thanks Mikhail. Looks like a good enough list for justifying a minor > release. > > HBASE-15181 is almost ready to go. > > What do you

Re: Branch for 1.3

2016-02-25 Thread Ted Yu
5, 2016 at 3:32 PM, Ted Yu wrote: > > > There is also hbase-spark module worth considering for backport. > > > > Current active JIRA is HBASE-14801 > > > > FYI > > > > On Thu, Feb 25, 2016 at 1:25 PM, Enis Söztutar > wrote: > > > >

Re: Branch for 1.3

2016-02-25 Thread Ted Yu
SCUSS] thread on mobs? I think last time the ball was > dropped when Andrew asked around who already uses mobs in trunk, if I've > not missed something? > > I think as was noted before, backporting of spark connector should be less > risky as it's less intrusive. So I guess

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-02-26 Thread Ted Yu
and thus not as invasive. > > > > > > Jon. > > > > > > On Tue, Jan 19, 2016 at 4:55 PM, Andrew Purtell < > > andrew.purt...@gmail.com> > > > wrote: > > > > > >> Pretty sure Sean expressed 1.2 is feature complete and I'

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-02-29 Thread Ted Yu
ar and don't know if >> they made it or not. >> >> Jon. >> >> [1] https://issues.apache.org/jira/browse/HBASE-15035 >> >> On Fri, Feb 26, 2016 at 12:27 PM, Andrew Purtell >> wrote: >> >>> ​I think we need at least one success

Re: /bin/ls permission issue on precommit tests

2016-03-02 Thread Ted Yu
Thanks for the information, Chris. For HBase precommit, there is checkbox 'USE_YETUS_PRERELEASE' which uses current HEAD of apache/yetus. Before Yetus 0.2.0 comes out, we can utilize this checkbox. Cheers On Wed, Mar 2, 2016 at 11:30 AM, Chris Nauroth wrote: > Hi Enis, > > Hadoop pre-commit w

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2016-03-02 Thread Ted Yu
nch. > > Jon. > > On Wed, Mar 2, 2016 at 6:44 PM, Devaraj Das wrote: > > > Sounds good to me, Jonathan. Although I suspect that at the end this will > > be close to what Ted Yu has in the backport patch but this is a more > > structured / reliable way of doing it.

[DISCUSS] Criteria for including MOB feature backport in branch-1

2016-03-03 Thread Ted Yu
Hi, As requested by Sean Busbey, I am starting a new thread w.r.t. backporting MOB feature to branch-1. This is to solicit discussion on the criteria for including MOB feature backport in branch-1. I can think of the following: 1. whether there is customer interest There is. See Jonathan's respo

Re: [DISCUSS] Criteria for including MOB feature backport in branch-1

2016-03-03 Thread Ted Yu
what sem ver is supposed to mean (not the api guarantees, > the actual meaning). > > Backporting major features is a bad habit that the Hadoop community seems > to have. We shouldn't follow their lead. > > On Thu, Mar 3, 2016 at 1:01 PM, Stack wrote: > > > On Thu, Ma

Re: [DISCUSS] Criteria for including MOB feature backport in branch-1

2016-03-03 Thread Ted Yu
ta driven assessment on stability, functionality, > and > > performance - both avoidance of regression and affirmative indication of > > the alleged benefit. > > > > On Thu, Mar 3, 2016 at 3:16 PM, Ted Yu wrote: > > > > > In the middle of writing respons

Re: A proposal for Provide key range support to bulkload to avoid too many reducers (HBASE-9556)

2016-03-05 Thread Ted Yu
y question are > > 1.How many Region the below command will create? > *create 'test', 'cf', SPLITS=> ['a', 'b', 'c'**]* > > 2.To find exact number for regions can i use RegionID counts? > > > cheers > > Beeshma > >

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-07 Thread Ted Yu
Running against jdk 7 only is fine by me. > On Mar 7, 2016, at 6:43 PM, Sean Busbey wrote: > > I tested things out, and while YETUS-297[1] is present the default runs all > plugins that can do multiple jdks against those available (jdk7 and jdk8 in > our case). > > We can configure things to o

Re: [DISCUSS] Backporting Regionserver Groups (HBASE-6721) to 1.x and 0.98

2016-03-19 Thread Ted Yu
For Spark, backporting to branch-1 makes sense since it is in hbase-spark module - only adds one line to root pom.xml. there has been frequent user query for when hbase-spark would be in an hbase release On Thu, Mar 17, 2016 at 8:26 AM, Matteo Bertozzi wrote: > If we cut master now we have > -

Re: Build failed in Jenkins: HBase-1.3 » latest1.8,yahoo-not-h2 #602

2016-03-19 Thread Ted Yu
HBASE-15456 has been rolled back due to unit test failure. FYI > On Mar 15, 2016, at 10:10 PM, Stack wrote: > > Could these two commits have been responsible for the below? Caused fail in > 1.7 and 1.8. > St.Ack > > On Tue, Mar 15, 2016 at 9:10 PM, Apache Jenkins Server < > jenk...@builds.ap

<    16   17   18   19   20   21   22   23   24   25   >