HTable thread safe for scans?

2013-07-15 Thread Lars George
Hi, Please see https://issues.apache.org/jira/browse/HBASE-7035#comment-13708295 for context. We added a while ago some wording around why HTable is not thread safe and how you should use HTablePool instead. I do get the point about the local write buffer, and also maybe if you do Get's or any

[jira] [Created] (HBASE-8948) Bound table pool size in Thrift 2 server

2013-07-15 Thread Lars George (JIRA)
Lars George created HBASE-8948: -- Summary: Bound table pool size in Thrift 2 server Key: HBASE-8948 URL: https://issues.apache.org/jira/browse/HBASE-8948 Project: HBase Issue Type: Sub-task

HBaseTestingUtility Failing

2013-07-15 Thread David Williams
Hi Ted, So, what would you recommend in terms of getting a working HbaseTestingUtility or just unit testing in general? It's pretty much a prerequisite for me to be able to introduce HBase into production. We have a strict continuous integration process and I need to be able to build

[jira] [Created] (HBASE-8949) hbase.mapreduce.hfileoutputformat.blocksize should configure with blocksize of a table

2013-07-15 Thread rajeshbabu (JIRA)
rajeshbabu created HBASE-8949: - Summary: hbase.mapreduce.hfileoutputformat.blocksize should configure with blocksize of a table Key: HBASE-8949 URL: https://issues.apache.org/jira/browse/HBASE-8949

hbase pull request: HBASE-8928 Make ChaosMonkey LoadTest tools extensible...

2013-07-15 Thread gautam-soni
GitHub user gautam-soni opened a pull request: https://github.com/apache/hbase/pull/5 HBASE-8928 Make ChaosMonkey LoadTest tools extensible, to allow additi... ...on of more actions and policies. This will help testers to extend the Actions and Policies to define newer

[jira] [Created] (HBASE-8950) Please Make HbaseTestingUtility Import without Dynamic Class Path Mods

2013-07-15 Thread David Williams (JIRA)
David Williams created HBASE-8950: - Summary: Please Make HbaseTestingUtility Import without Dynamic Class Path Mods Key: HBASE-8950 URL: https://issues.apache.org/jira/browse/HBASE-8950 Project:

Re: HBaseTestingUtility Failing

2013-07-15 Thread Ted Yu
I would be busy today so expect delay in future response. bq. Recall that this is not an issue on Mac OSX for some odd reason I didn't reproduce the issue you mentioned on either OSX or Linux. Maybe people who use CentOS for ci can comment on this matter. Cheers On Mon, Jul 15, 2013 at 8:01

Re: HBaseTestingUtility Failing

2013-07-15 Thread David Williams
I doubt this has anything todo specifically with CentOS etc. I am not privy to your setup up but the steps to reproduce are easy. 1. Get a linux distro such as CentOS. Put it say, in a VM such as Vmware Fusion on Mac. 2. Install Java 3. Try to start a mini cluster (will fail) The bottom

Re: HBaseTestingUtility Failing

2013-07-15 Thread Gary Helmling
Hi David, I can't say for certain given the test output (would need to see the logs generated by the datanodes), but there is a common issue running mini cluster unit tests if the environment's umask is not set to 022. This is due to https://issues.apache.org/jira/browse/HDFS-2556 where the mini

Re: Error with hbase shell when building trunk or 0.95 against hadoop 2

2013-07-15 Thread Jean-Daniel Cryans
Have you tried install instead of package? J-D On Sat, Jul 13, 2013 at 10:42 AM, Rob Povey r...@maana.io wrote: hbase shell LoadError: no such file to load -- hbase require at org/jruby/RubyKernel.java:1062 (root) at /Users/rob/hbase-local/bin/hirb.rb:100 This is probably a

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread Andrew Purtell
umask 022 first, then run the tests On Fri, Jul 12, 2013 at 7:37 PM, David Williams mobiusinvers...@gmail.comwrote: Hi all, I am having an issue starting the a mini cluster for the HBaseTestingUtility. In short I can on Mac OSX, but cannot on Linux. But the error is cryptic and I don't

Re: Error with hbase shell when building trunk or 0.95 against hadoop 2

2013-07-15 Thread Rob Povey
Yes it made no difference. Rob Povey r...@maana.io On Jul 15, 2013, at 10:37 AM, Jean-Daniel Cryans jdcry...@apache.org wrote: Have you tried install instead of package? J-D On Sat, Jul 13, 2013 at 10:42 AM, Rob Povey r...@maana.io wrote: hbase shell LoadError: no such file to load

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread David Williams
Hi Andrew, Yes that solves it. Care to answer the SO question with some details about why? I put a 100pt bounty. On Jul 15, 2013, at 10:54 AM, Andrew Purtell apurt...@apache.org wrote: umask 022 first, then run the tests On Fri, Jul 12, 2013 at 7:37 PM, David Williams

[jira] [Created] (HBASE-8951) DNS not resolving should no longer show in logs as ERROR

2013-07-15 Thread Ron Echeverri (JIRA)
Ron Echeverri created HBASE-8951: Summary: DNS not resolving should no longer show in logs as ERROR Key: HBASE-8951 URL: https://issues.apache.org/jira/browse/HBASE-8951 Project: HBase Issue

[jira] [Resolved] (HBASE-8942) DFS errors during a read operation (get/scan), may cause write outliers

2013-07-15 Thread Amitanand Aiyer (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amitanand Aiyer resolved HBASE-8942. Resolution: Fixed Fix Version/s: 0.89-fb DFS errors during a read operation

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread Andrew Purtell
On Mon, Jul 15, 2013 at 11:28 AM, David Williams mobiusinvers...@gmail.comwrote: Care to answer the SO question with some details about why? I put a 100pt bounty. Thanks for the offer. Anyone else here is welcome to take it up. Stack? Ted? -- Best regards, - Andy Problems worthy of

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread David Williams
Gary? http://stackoverflow.com/questions/17625938/hbase-minidfscluster-java-fails-in-certain-environments On Jul 15, 2013, at 12:03 PM, Andrew Purtell apurt...@apache.org wrote: On Mon, Jul 15, 2013 at 11:28 AM, David Williams mobiusinvers...@gmail.com wrote: Care to answer the SO question

[jira] [Resolved] (HBASE-8944) Document workaround for MiniDFSCluster exceptions when running tests

2013-07-15 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-8944. --- Resolution: Fixed Fix Version/s: 0.98.0 Document workaround for MiniDFSCluster

RE: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread Vladimir Rodionov
Quick Google MiniHBaseCluster master not initialized gives this link: http://girlincomputerscience.blogspot.com/2012_12_01_archive.html with the same advice: umask 022 Unfortunately, it did not help in my case (Mac OSX). Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ,

[jira] [Created] (HBASE-8952) Missing error handling can cause RegionServer RPC thread to busy loop forever

2013-07-15 Thread Benoit Sigoure (JIRA)
Benoit Sigoure created HBASE-8952: - Summary: Missing error handling can cause RegionServer RPC thread to busy loop forever Key: HBASE-8952 URL: https://issues.apache.org/jira/browse/HBASE-8952

[jira] [Resolved] (HBASE-8661) [rest] support REST over https

2013-07-15 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang resolved HBASE-8661. Resolution: Fixed Fix Version/s: 0.95.2 0.98.0 Fixed with HBASE-8662.

[jira] [Resolved] (HBASE-8660) [rest] support secure REST access

2013-07-15 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang resolved HBASE-8660. Resolution: Fixed [rest] support secure REST access -

[jira] [Created] (HBASE-8954) TestSplitLogWorker#testPreemptTask failed

2013-07-15 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-8954: -- Summary: TestSplitLogWorker#testPreemptTask failed Key: HBASE-8954 URL: https://issues.apache.org/jira/browse/HBASE-8954 Project: HBase Issue Type: Test

[jira] [Created] (HBASE-8955) TestStochasticLoadBalancer timedout

2013-07-15 Thread stack (JIRA)
stack created HBASE-8955: Summary: TestStochasticLoadBalancer timedout Key: HBASE-8955 URL: https://issues.apache.org/jira/browse/HBASE-8955 Project: HBase Issue Type: Bug Reporter:

[jira] [Resolved] (HBASE-8955) TestStochasticLoadBalancer timedout

2013-07-15 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8955. -- Resolution: Fixed Fix Version/s: 0.95.2 0.98.0 Assignee: stack Committed

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread Stack
On Mon, Jul 15, 2013 at 12:03 PM, Andrew Purtell apurt...@apache.orgwrote: On Mon, Jul 15, 2013 at 11:28 AM, David Williams mobiusinvers...@gmail.comwrote: Care to answer the SO question with some details about why? I put a 100pt bounty. Thanks for the offer. Anyone else here is

[jira] [Created] (HBASE-8956) A couple of small misspellings thoughout the codebase.

2013-07-15 Thread Alex Newman (JIRA)
Alex Newman created HBASE-8956: -- Summary: A couple of small misspellings thoughout the codebase. Key: HBASE-8956 URL: https://issues.apache.org/jira/browse/HBASE-8956 Project: HBase Issue Type:

Re: The Jenkins VMs are increasingly slow / overloaded

2013-07-15 Thread Andrew Purtell
The EC2 Jenkins for HBase is still active, just running a reduced schedule. I have received the following notice from Amazon regarding the VM http://54.241.6.143/, FYI: Zone: us-west-1a Event Type: system-maintenance Description: Your instance network connections will be restarted during this

Re: The Jenkins VMs are increasingly slow / overloaded

2013-07-15 Thread Ted Yu
Thanks for the notice, Andy. bq. End Time: 2013-07-17 00:00 PDT Should the End Time be on 07-18 (just guessing) ? On Mon, Jul 15, 2013 at 3:27 PM, Andrew Purtell apurt...@apache.org wrote: The EC2 Jenkins for HBase is still active, just running a reduced schedule. I have received the

Re: The Jenkins VMs are increasingly slow / overloaded

2013-07-15 Thread Andrew Purtell
On Mon, Jul 15, 2013 at 3:30 PM, Ted Yu yuzhih...@gmail.com wrote: Thanks for the notice, Andy. bq. End Time: 2013-07-17 00:00 PDT Should the End Time be on 07-18 (just guessing) ? Yeah, I don't know... that's what they said.

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread Gary Helmling
I'll put an explanation up. On Mon, Jul 15, 2013 at 3:36 PM, David Williams mobiusinvers...@gmail.comwrote: OMG, someone please take the 100pt bounty :-) On Jul 15, 2013, at 2:44 PM, Stack st...@duboce.net wrote: On Mon, Jul 15, 2013 at 12:03 PM, Andrew Purtell apurt...@apache.org

Re: Help with HBaseTestingUtility / MiniDFSCluster

2013-07-15 Thread Gary Helmling
Hi David, I filled in an answer on SO. Hopefully that provides some context on the underlying problem. --gh On Mon, Jul 15, 2013 at 3:49 PM, Gary Helmling ghelml...@gmail.com wrote: I'll put an explanation up. On Mon, Jul 15, 2013 at 3:36 PM, David Williams mobiusinvers...@gmail.com

Re: Error with hbase shell when building trunk or 0.95 against hadoop 2

2013-07-15 Thread Stack
linux? Where are you rnning hbase shell? Under hbase root.dir? Sounds like classpathing. St.Ack On Sat, Jul 13, 2013 at 10:42 AM, Rob Povey r...@maana.io wrote: hbase shell LoadError: no such file to load -- hbase require at org/jruby/RubyKernel.java:1062 (root) at

[jira] [Created] (HBASE-8957) TestDrainingServer. testDrainingServerWithAbort fails

2013-07-15 Thread stack (JIRA)
stack created HBASE-8957: Summary: TestDrainingServer. testDrainingServerWithAbort fails Key: HBASE-8957 URL: https://issues.apache.org/jira/browse/HBASE-8957 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-8908) Backport HBASE-8882 and HBASE-8904 (An Integration Test to Test MTTR) to 0.94

2013-07-15 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-8908. --- Resolution: Fixed Fix Version/s: 0.94.10 Hadoop Flags: Reviewed Committed to

[jira] [Created] (HBASE-8958) Sometimes we refer to the single .META. table region as .META.,,1 and other times as .META.,,1.1028785192

2013-07-15 Thread stack (JIRA)
stack created HBASE-8958: Summary: Sometimes we refer to the single .META. table region as .META.,,1 and other times as .META.,,1.1028785192 Key: HBASE-8958 URL: https://issues.apache.org/jira/browse/HBASE-8958