[jira] [Created] (HBASE-8352) Rename '.snapshot' directory

2013-04-16 Thread Ted Yu (JIRA)
Ted Yu created HBASE-8352: - Summary: Rename '.snapshot' directory Key: HBASE-8352 URL: https://issues.apache.org/jira/browse/HBASE-8352 Project: HBase Issue Type: Bug Reporter: Ted Yu

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread Ted Yu
I have logged HBASE-8352 Cheers On Mon, Apr 15, 2013 at 9:17 PM, Ted Yu yuzhih...@gmail.com wrote: I have a patch which touched these tests: http://pastebin.com/P4p8LEAZ I am running 0.94 test suite now - will publish patch and test result in the morning. Cheers On Mon, Apr 15, 2013

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread Tsz Wo Sze
Hi Ted, It would be great that if Hbase could use a different name since, as you mentioned, .sanpshot is user visible in HDFS.  It is used for specifying snapshot paths.  For example, the path /foo/.snapshot/s0/bar is used for accessing /foo/bar in snapshot s0 of /foo.  Thanks. Tsz-Wo

Build failed in Jenkins: hbase-0.95-on-hadoop2 #70

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/hbase-0.95-on-hadoop2/70/changes Changes: [enis] HBASE-8341 RestoreSnapshotHandler.prepare() is not called by SnapshotManager and TakeSnapshotHandler should first acquire the table lock [tedyu] HBASE-8326 mapreduce.TestTableInputFormatScan times out frequently

Build failed in Jenkins: hbase-0.95 #149

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/hbase-0.95/149/changes Changes: [enis] HBASE-8341 RestoreSnapshotHandler.prepare() is not called by SnapshotManager and TakeSnapshotHandler should first acquire the table lock [tedyu] HBASE-8326 mapreduce.TestTableInputFormatScan times out frequently (Nick

Jenkins build is back to normal : HBase-0.94-security #137

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.94-security/137/changes

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #132

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/132/ -- [...truncated 7644 lines...] Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.542 sec Running

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #500

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/500/changes Changes: [jmhsieh] HBASE-8351 Minor typo in Bytes IllegalArgumentException throw (Raymond Liu) [enis] HBASE-8341 RestoreSnapshotHandler.prepare() is not called by SnapshotManager and TakeSnapshotHandler should first

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread Jean-Marc Spaggiari
+1 for Jonathan's solution. We need to allow the user to configure that for upcoming releases. 2013/4/15 Tsz Wo Sze szets...@yahoo.com Hi Ted, It would be great that if Hbase could use a different name since, as you mentioned, .sanpshot is user visible in HDFS. It is used for specifying

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread Jonathan Hsieh
I was away from keyboard when I asserted that hdfs snapshot was a hadoop 2.1 or 3.0 feature. Apparently it is targeted as a hadoop 2.0.5 feature. (I'm a little surprised -- expected this to be a hadoop2 compat breaking feature) -- so I agree that this is a bit more urgent. Anyway, I agree that

[jira] [Created] (HBASE-8353) ROOT/META regions are hanging if master restarted while CLOSING

2013-04-16 Thread rajeshbabu (JIRA)
rajeshbabu created HBASE-8353: - Summary: ROOT/META regions are hanging if master restarted while CLOSING Key: HBASE-8353 URL: https://issues.apache.org/jira/browse/HBASE-8353 Project: HBase

True Block Cache Hit ratio's

2013-04-16 Thread Varun Sharma
Hi, I am wondering whether the HBase cachingHitRatio metrics that the region server UI shows, can get me a break down by data blocks. I always see this number to be very high and that could be exagerated by the fact that each lookup hits the index blocks and bloom filter blocks in the block cache

Re: True Block Cache Hit ratio's

2013-04-16 Thread ramkrishna vasudevan
If not, my sense is that it would be pretty valuable to add one. Thoughts ? Agree. Regards Ram On Tue, Apr 16, 2013 at 10:00 PM, Varun Sharma va...@pinterest.com wrote: Hi, I am wondering whether the HBase cachingHitRatio metrics that the region server UI shows, can get me a break down by

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread Ted Yu
Let's get proper release notes for HBASE-8352 . Either Lars or I can send out notification to user mailing list so that there is enough preparation for this change. Cheers On Tue, Apr 16, 2013 at 8:46 AM, Jonathan Hsieh j...@cloudera.com wrote: I was away from keyboard when I asserted that

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread lars hofhansl
Please see my last comment on the jira. We can make this work without breaking users who are using HDFS snapshots. From: Ted Yu yuzhih...@gmail.com To: dev@hbase.apache.org Cc: hdfs-...@hadoop.apache.org; lars hofhansl la...@apache.org Sent: Tuesday, April

[jira] [Created] (HBASE-8354) Backport HBASE-7878 'recoverFileLease does not check return value of recoverLease' to 0.94

2013-04-16 Thread Ted Yu (JIRA)
Ted Yu created HBASE-8354: - Summary: Backport HBASE-7878 'recoverFileLease does not check return value of recoverLease' to 0.94 Key: HBASE-8354 URL: https://issues.apache.org/jira/browse/HBASE-8354 Project:

Re: replication scopes in WAL

2013-04-16 Thread Jean-Daniel Cryans
Also there was a good discussion in this thread: https://issues.apache.org/jira/browse/HBASE-7280 J-D On Tue, Apr 16, 2013 at 12:54 AM, Bijieshan bijies...@huawei.com wrote: Yes, it is only used for indicating which KVs to replicate. See ReplicationSource#removeNonReplicableEdits. bq.If

[jira] [Created] (HBASE-8355) BaseRegionObserver#preCompactScannerOpen returns null

2013-04-16 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-8355: - Summary: BaseRegionObserver#preCompactScannerOpen returns null Key: HBASE-8355 URL: https://issues.apache.org/jira/browse/HBASE-8355 Project: HBase Issue

[jira] [Reopened] (HBASE-8326) mapreduce.TestTableInputFormatScan times out frequently

2013-04-16 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-8326: -- Lemme reopen to keep of this for the 0.94.7RC mapreduce.TestTableInputFormatScan

Re: No 0.94 checkins please

2013-04-16 Thread Nick Dimiduk
I'd like to see the addendum to HBASE-8326 go out with the original patch, please. Testing it locally, will post in a few minutes. On Mon, Apr 15, 2013 at 7:05 PM, lars hofhansl la...@apache.org wrote: All clear. I have all I need from the 54. jenkins builds. However, Ted Yu mentioned an

Re: No 0.94 checkins please

2013-04-16 Thread Nick Dimiduk
Patches posted. Sorry for the delay. -n On Tue, Apr 16, 2013 at 1:33 PM, Nick Dimiduk ndimi...@gmail.com wrote: I'd like to see the addendum to HBASE-8326 go out with the original patch, please. Testing it locally, will post in a few minutes. On Mon, Apr 15, 2013 at 7:05 PM, lars hofhansl

Re: Declaring HBase Public API in 0.94

2013-04-16 Thread Aleksandr Shulman
Hello, I put together a JDiff compatibility tool that was committed to trunk. Would someone be kind enough to backport it into 0.94.8? Here is the commit for the tool: https://github.com/apache/hbase/commit/379f88f0b55b817cfa395326d5da0e3d6552ef28 Here is the review:

[jira] [Resolved] (HBASE-8326) mapreduce.TestTableInputFormatScan times out frequently

2013-04-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-8326. --- Resolution: Fixed mapreduce.TestTableInputFormatScan times out frequently

Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot

2013-04-16 Thread Ted Yu
Hi, Please take a look at patch v5 attached to HBASE-8352. It would be nice to resolve this blocker today so that 0.94.7 RC can be cut. Thanks On Tue, Apr 16, 2013 at 10:12 AM, lars hofhansl la...@apache.org wrote: Please see my last comment on the jira. We can make this work without

Build failed in Jenkins: HBase-0.95-Hadoop-2 #133

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.95-Hadoop-2/133/changes Changes: [jmhsieh] HBASE-8349 TestLogRolling#testLogRollOnDatanodeDeath hangs under hadoop2 profile -- [...truncated 7752 lines...] Running org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner

Re: Declaring HBase Public API in 0.94

2013-04-16 Thread Nick Dimiduk
Aleks, With the exception of the source paths [0], [1], I don't see anything that needs changed for 0.94. In fact, those paths look correct for 0.94 but wrong for trunk. I would have expected to see all of the modules broken out. Are you sure this generates the reports you expect when run on

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #133

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/133/changes Changes: [jmhsieh] HBASE-8349 TestLogRolling#testLogRollOnDatanodeDeath hangs under hadoop2 profile -- [...truncated 7647 lines...] Running

Build failed in Jenkins: HBase-0.95 #140

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.95/140/changes Changes: [jmhsieh] HBASE-8349 TestLogRolling#testLogRollOnDatanodeDeath hangs under hadoop2 profile -- [...truncated 7265 lines...] Downloading:

Build failed in Jenkins: HBase-0.94-Hadoop-2 #73

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.94-Hadoop-2/73/changes Changes: [tedyu] HBASE-8326 Addendum simplifies lookup in packagedClasses (Nick) -- [...truncated 5268 lines...] Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks Tests run:

Build failed in Jenkins: HBase-0.94-Security-Hadoop-2 #72

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.94-Security-Hadoop-2/72/changes Changes: [tedyu] HBASE-8326 Addendum simplifies lookup in packagedClasses (Nick) -- [...truncated 3113 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.547 sec

[jira] [Created] (HBASE-8356) Move Small Clients into hbase-client

2013-04-16 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-8356: Summary: Move Small Clients into hbase-client Key: HBASE-8356 URL: https://issues.apache.org/jira/browse/HBASE-8356 Project: HBase Issue Type: Task

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #134

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/134/changes Changes: [tedyu] HBASE-8326 Addendum simplifies lookup in packagedClasses (Nick) -- [...truncated 3841 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.47 sec Running

Jenkins build is back to normal : HBase-0.95 #141

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.95/141/changes

Build failed in Jenkins: HBase-0.95-Hadoop-2 #134

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.95-Hadoop-2/134/changes Changes: [tedyu] HBASE-8326 Addendum simplifies lookup in packagedClasses (Nick) -- [...truncated 4604 lines...] Running org.apache.hadoop.hbase.master.TestDeadServer Tests run: 3, Failures: 0,

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #135

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/135/changes Changes: [jdcryans] HBASE-7828 Expose HBase Scan object's batch property for intra-row batching in Thrift API (Shivendra Pratap Singh via JD) -- [...truncated 4412 lines...]

[jira] [Resolved] (HBASE-8352) Rename '.snapshot' directory

2013-04-16 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8352. -- Resolution: Fixed Rename '.snapshot' directory

Build failed in Jenkins: HBase-0.95-Hadoop-2 #135

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.95-Hadoop-2/135/changes Changes: [jdcryans] HBASE-7828 Expose HBase Scan object's batch property for intra-row batching in Thrift API (Shivendra Pratap Singh via JD) -- [...truncated 7775 lines...]

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #136

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/136/changes Changes: [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) -- [...truncated 4072 lines...] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:238)

Build failed in Jenkins: HBase-0.94-Hadoop-2 #74

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.94-Hadoop-2/74/changes Changes: [Lars Hofhansl] CHANGES.txt 0.94.7RC0 [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) -- [...truncated 2486 lines...] Running org.apache.hadoop.hbase.master.TestMasterFileSystem

Build failed in Jenkins: HBase-0.95-Hadoop-2 #136

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.95-Hadoop-2/136/changes Changes: [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) -- [...truncated 3899 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.3 sec Running

Build failed in Jenkins: HBase-0.94-Security-Hadoop-2 #73

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.94-Security-Hadoop-2/73/changes Changes: [Lars Hofhansl] CHANGES.txt 0.94.7RC0 [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) -- [...truncated 2497 lines...] Running

[jira] [Created] (HBASE-8357) current region server failover mechanism for replication can lead to stale region server whose left hlogs can't be replicated by other region server

2013-04-16 Thread Feng Honghua (JIRA)
Feng Honghua created HBASE-8357: --- Summary: current region server failover mechanism for replication can lead to stale region server whose left hlogs can't be replicated by other region server Key: HBASE-8357 URL:

Jenkins build is back to normal : hbase-0.95 #150

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/hbase-0.95/150/changes

Build failed in Jenkins: HBase-0.94-Security-Hadoop-2 #74

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.94-Security-Hadoop-2/74/ -- [...truncated 2669 lines...] Running org.apache.hadoop.hbase.security.token.TestZKSecretWatcher Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.047 sec Running

Build failed in Jenkins: hbase-0.95-on-hadoop2 #71

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/hbase-0.95-on-hadoop2/71/changes Changes: [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) [jdcryans] HBASE-7828 Expose HBase Scan object's batch property for intra-row batching in Thrift API (Shivendra Pratap Singh via JD) [tedyu]

Jenkins build is back to normal : HBase-0.94 #962

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.94/962/changes

Build failed in Jenkins: HBase-TRUNK #4067

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/4067/changes Changes: [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) [jdcryans] HBASE-7828 Expose HBase Scan object's batch property for intra-row batching in Thrift API (Shivendra Pratap Singh via JD) [tedyu] HBASE-8326

Build failed in Jenkins: HBase-0.94-Hadoop-2 #75

2013-04-16 Thread apurtell
See http://54.241.6.143/job/HBase-0.94-Hadoop-2/75/ -- [...truncated 5264 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.545 sec Running org.apache.hadoop.hbase.client.TestMetaScanner Tests run: 1, Failures: 0, Errors: 0,

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #501

2013-04-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/501/changes Changes: [tedyu] HBASE-8352 Rename '.snapshot' directory (Ted Yu) [jdcryans] HBASE-7828 Expose HBase Scan object's batch property for intra-row batching in Thrift API (Shivendra Pratap Singh via JD) [tedyu]