Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Enis Söztutar
Agreed, this seems like an hdfs issue unless hbase itself does not close the hfiles properly. But judging from the fact that you were able to circumvent the problem by getting reducing the cache size, it does seem unlikely. I don't think the local block reader will be notified when a file/block is

[jira] [Resolved] (HBASE-11407) hbase-client should not require Jackson for pure HBase queries be executed

2014-06-25 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-11407. Resolution: Fixed Fix Version/s: 0.99.0 Hadoop Flags: Reviewed > hbase-client

Re: Upcoming branch-1.0

2014-06-25 Thread Enis Söztutar
I think I might need that, but I am trying to reduce that time to be limited to a couple of hours rather than 1 whole day. Every rebase is gradually less painful. We have only 6 unit test failures so far, once it is down to zero I'll send a quick note for holding off commits. Enis On Wed, Jun 25

[jira] [Resolved] (HBASE-8479) AggregationClient breaks bigtop compile

2014-06-25 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-8479. --- Resolution: Cannot Reproduce Compiling 0.96 and 0.98 with Oracle Java 6u45 works locally. >

Fwd: Disk space leak when using HBase and HDFS ShortCircuit

2014-06-25 Thread Andrew Purtell
Forwarded -- Forwarded message -- From: Vladimir Rodionov Date: Wed, Jun 25, 2014 at 12:03 PM Subject: RE: Disk space leak when using HBase and HDFS ShortCircuit To: "u...@hbase.apache.org" >> Apparently those file descriptors were stored by the HDFS >> ShortCircuit cache. As

Re: jdk 1.7 & trunk

2014-06-25 Thread Andrew Purtell
We have 0.94 for JDK 6 diehards. I'd be fine with moving to 7+ for 0.98 if there's consensus to do it. > On Jun 25, 2014, at 2:38 PM, Nicolas Liochon wrote: > > Yeah. It would also be so much simpler when it comes to backporting from > master to 0.98, and 0.98 could very likely live a long li

Re: jdk 1.7 & trunk

2014-06-25 Thread Andrew Purtell
Try compiling with Oracle Java 6. Same result ? > On Jun 25, 2014, at 12:54 PM, Konstantin Boudnik wrote: > > Back in time of JDK6 GA - when I was still working in Sun's JDK team - we had > companies sitting on 1.4 and paying _a lot_ of money for Sun support of it. > So... > > That said, I thin

Re: jdk 1.7 & trunk

2014-06-25 Thread Nicolas Liochon
Yeah. It would also be so much simpler when it comes to backporting from master to 0.98, and 0.98 could very likely live a long life, a la 0.94. So the sooner we're clear on this the better. And anyway, Hadoop will likely drop the JDK6 in a 2.x release, so we will be stuck with a 2.5 or so if we d

Re: jdk 1.7 & trunk

2014-06-25 Thread Andrew Purtell
There are some concurrency library classes in 7 not in 6. Came up recently on HBASE-11297 > On Jun 25, 2014, at 12:13 PM, Stack wrote: > >> On Wed, Jun 25, 2014 at 11:48 AM, Nicolas Liochon wrote: >> >> Ok Enis I like the definition you put in the thread. >> >> Dropping support explicitly me

Re: Upcoming branch-1.0

2014-06-25 Thread Stack
You want a moratorium on master commits till 10070 goes in Enis? St.Ack On Tue, Jun 24, 2014 at 7:47 PM, Enis Söztutar wrote: > Just wanted to give a quick heads up on upcoming branch-1.0. > > According to [1], I was planning to create the branch yesterday, but I am > holding off for finishing

[jira] [Created] (HBASE-11413) [findbugs] RV: Negating the result of compareTo()/compare()

2014-06-25 Thread Mike Drob (JIRA)
Mike Drob created HBASE-11413: - Summary: [findbugs] RV: Negating the result of compareTo()/compare() Key: HBASE-11413 URL: https://issues.apache.org/jira/browse/HBASE-11413 Project: HBase Issue

Re: jdk 1.7 & trunk

2014-06-25 Thread Konstantin Boudnik
Back in time of JDK6 GA - when I was still working in Sun's JDK team - we had companies sitting on 1.4 and paying _a lot_ of money for Sun support of it. So... That said, I think moving to JDK7 is pretty much has happened already for HBase, because e.g. 0.98.2 can not be build with JDK6 because we

Re: jdk 1.7 & trunk

2014-06-25 Thread Enis Söztutar
My vote will be 1) Not drop support in JDK6 in 0.98.x series as per above. 2) Drop support to JDK6 in 1.x series. Also see recent jira: https://issues.apache.org/jira/browse/HBASE-11102 Enis On Wed, Jun 25, 2014 at 12:13 PM, Stack wrote: > On Wed, Jun 25, 2014 at 11:48 AM, Nicolas Liochon

Re: jdk 1.7 & trunk

2014-06-25 Thread Stack
On Wed, Jun 25, 2014 at 11:48 AM, Nicolas Liochon wrote: > Ok Enis I like the definition you put in the thread. > > Dropping support explicitly means that we stop building against > JDK6 in jenkins, and won't try to fix issues if they are jdk6 only. Release > testing and unit tests are done on jd

Re: jdk 1.7 & trunk

2014-06-25 Thread Nicolas Liochon
> it would mean that you'd need to upgrade Java in order to get HBase bug fixes :) Yes if you're using hbase 0.98 with the JDK 1.6 in production. If that's the case yes we should not drop the support. On Wed, Jun 25, 2014 at 8:54 PM, Jean-Daniel Cryans wrote: > On Wed, Jun 25, 2014 at 11:48

Re: jdk 1.7 & trunk

2014-06-25 Thread Jean-Daniel Cryans
On Wed, Jun 25, 2014 at 11:48 AM, Nicolas Liochon wrote: > Ok Enis I like the definition you put in the thread. > > Dropping support explicitly means that we stop building against > JDK6 in jenkins, and won't try to fix issues if they are jdk6 only. Release > testing and unit tests are done on jd

Re: jdk 1.7 & trunk

2014-06-25 Thread Nicolas Liochon
Ok Enis I like the definition you put in the thread. Dropping support explicitly means that we stop building against JDK6 in jenkins, and won't try to fix issues if they are jdk6 only. Release testing and unit tests are done on jdk7. And it implies; we may start to use 1.7 specific features. Wit

Re: jdk 1.7 & trunk

2014-06-25 Thread Enis Söztutar
See the thread: https://mail-archives.apache.org/mod_mbox/hbase-dev/201404.mbox/%3CCAMUu0w_KgwTLWkTc3W85H4yYuDSaEn=Ncf7ziRhhMZ=hfod...@mail.gmail.com%3E There was no conclusion in that thread. But it should be ok to start a VOTE I guess. Enis On Wed, Jun 25, 2014 at 10:29 AM, Andrew Purtell w

Re: Findbug warning reports on ASF jenkins

2014-06-25 Thread Mikhail Antonov
I see. Thanks Ted! 2014-06-25 10:50 GMT-07:00, Ted Yu : > Only the most recent 15 QA reports are kept. > The increase in findbugs warnings seemed to have happened earlier than Jun > 24, 2014 4:58:10 AM > . > > You can compare the findbugsX

Re: Findbug warning reports on ASF jenkins

2014-06-25 Thread Ted Yu
Only the most recent 15 QA reports are kept. The increase in findbugs warnings seemed to have happened earlier than Jun 24, 2014 4:58:10 AM . You can compare the findbugsXml.xml with and without your patch. Cheers On Wed, Jun 25, 2014 a

Re: Findbug warning reports on ASF jenkins

2014-06-25 Thread Mikhail Antonov
Thanks Ted. I was actually looking for the way to see the list of new warnings specifically (ones reported as introduced by the patch being tested). -Mikhail 2014-06-25 10:21 GMT-07:00 Ted Yu : > You can generate findbugs report yourself: > mvn clean package findbugs:findbugs -DskipTests > > Th

Re: jdk 1.7 & trunk

2014-06-25 Thread Andrew Purtell
Er, I mean no user should be running on a runtime less than 7, they are all EOL... On Wed, Jun 25, 2014 at 10:28 AM, Andrew Purtell wrote: > > On Wed, Jun 25, 2014 at 9:15 AM, Nicolas Liochon > wrote: > >> Should we be 1.7 only for trunk / 1.0? >> This would mean using the 1.7 features. >> > >

Re: jdk 1.7 & trunk

2014-06-25 Thread Andrew Purtell
On Wed, Jun 25, 2014 at 9:15 AM, Nicolas Liochon wrote: > Should we be 1.7 only for trunk / 1.0? > This would mean using the 1.7 features. > I think this is prudent. Hadoop common is having a similar discussion and I think converging on consensus that they would be ok with their trunk including

Re: Findbug warning reports on ASF jenkins

2014-06-25 Thread Ted Yu
You can generate findbugs report yourself: mvn clean package findbugs:findbugs -DskipTests Then look for findbugsXml.xml under target directory of respective module. Cheers On Wed, Jun 25, 2014 at 10:16 AM, Mikhail Antonov wrote: > Guys, could someone please suggest me where findbug reports a

Findbug warning reports on ASF jenkins

2014-06-25 Thread Mikhail Antonov
Guys, could someone please suggest me where findbug reports are kept on jenkins boxes? The links posted by hadoop-qa bot seems to be broken (like this one - https://builds.apache.org/job/PreCommit-HBASE-Build/9840//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html), and if I

Re: jdk 1.7 & trunk

2014-06-25 Thread Nicolas Liochon
If hadoop does not support the 1.6 we can't support it either. But we can drop the 1.6 ealier than them... On Wed, Jun 25, 2014 at 6:54 PM, Ted Yu wrote: > Here is the thread in hadoop w.r.t. JDK version: > > http://search-hadoop.com/m/LgpTk2GHceb2/moving+to+jdk+major&subj=Re+Moving+to+JDK7+JDK

Re: jdk 1.7 & trunk

2014-06-25 Thread Ted Yu
Here is the thread in hadoop w.r.t. JDK version: http://search-hadoop.com/m/LgpTk2GHceb2/moving+to+jdk+major&subj=Re+Moving+to+JDK7+JDK8+and+new+major+releases Sounds like support for JDK6 may be dropped in hadoop-2.6 or hadoop-2.7. Cheers On Wed, Jun 25, 2014 at 9:45 AM, Nick Dimiduk wrote:

Re: jdk 1.7 & trunk

2014-06-25 Thread Nick Dimiduk
I think it's time to move master/1.0 to 1.7, though, where is Hadoop on this? We should support 1.6 if we plan to continue to support hadoop versions that support 1.6. On Wed, Jun 25, 2014 at 9:15 AM, Nicolas Liochon wrote: > Hi all, > > HBASE-11297 just broke the build because it uses a Concur

jdk 1.7 & trunk

2014-06-25 Thread Nicolas Liochon
Hi all, HBASE-11297 just broke the build because it uses a ConcurrentLinkedDeque. Should we be 1.7 only for trunk / 1.0? This would mean using the 1.7 features. What about .98? We would need to update our precommit env, it still builds with 1.6 today... Shall we start a vote? Nicolas

[jira] [Resolved] (HBASE-11027) Remove kv.isDeleteXX() and related methods and use CellUtil apis.

2014-06-25 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan resolved HBASE-11027. Resolution: Fixed Hadoop Flags: Reviewed > Remove kv.isDeleteXX() an

[jira] [Created] (HBASE-11412) Minimize a number of hbase-client transitive dependencies

2014-06-25 Thread Sergey Beryozkin (JIRA)
Sergey Beryozkin created HBASE-11412: Summary: Minimize a number of hbase-client transitive dependencies Key: HBASE-11412 URL: https://issues.apache.org/jira/browse/HBASE-11412 Project: HBase