[jira] [Resolved] (HBASE-3967) Support deletes in HFileOutputFormat based bulk import mechanism

[ https://issues.apache.org/jira/browse/HBASE-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-3967. -- Resolution: Not A Problem Assignee: Nick Dimiduk Assigning Nick -- since he did the work to verify what w

[jira] [Resolved] (HBASE-8301) Document for hbase.rpc.timeout

[ https://issues.apache.org/jira/browse/HBASE-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8301. -- Resolution: Fixed Fix Version/s: 0.95.1 0.98.0 Hadoop Flags: Reviewed Committed

Re: Does compatibility between versions also mean binary compatibility?

On Mon, Apr 8, 2013 at 8:02 PM, Enis Söztutar wrote: > For normal client-level API's, I am not convinced that we should keep > binary compatibility between major versions. It will tie our hands of doing > some changes between major versions. > I agree with this. Once we go 1.0 I'd be more incli

[jira] [Reopened] (HBASE-8017) Upgrade hadoop 1 dependency to 1.1.2

[ https://issues.apache.org/jira/browse/HBASE-8017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-8017: --- > Upgrade hadoop 1 dependency to 1.1.2 > > > Key: HBASE-

[jira] [Resolved] (HBASE-8302) HBase dynamic configuration

[ https://issues.apache.org/jira/browse/HBASE-8302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-8302. --- Resolution: Duplicate Dup of HBASE-3909 > HBase dynamic configuration >

Re: Anyone know how to get surefire to list timed out tests?

A little parsing is needed: ZB_STACK=`jps | grep surefirebooter | cut -d ' ' -f 1 | xargs -n 1 jstack | grep ".test" | grep "\.java"` On Mon, Apr 8, 2013 at 8:14 PM, Andrew Purtell wrote: > I just checked and the test name isn't embedded in the jps output. Will try > running with mvn -X in

Re: Anyone know how to get surefire to list timed out tests?

I just checked and the test name isn't embedded in the jps output. Will try running with mvn -X instead. On Mon, Apr 8, 2013 at 8:12 PM, Andrew Purtell wrote: > Thanks Ted. Good idea. > > > On Mon, Apr 8, 2013 at 8:06 PM, Ted Yu wrote: > >> Andy: >> Have you looked at how dev-support/test-pat

Re: Anyone know how to get surefire to list timed out tests?

Thanks Ted. Good idea. On Mon, Apr 8, 2013 at 8:06 PM, Ted Yu wrote: > Andy: > Have you looked at how dev-support/test-patch.sh finds zombie tests ? > It starts from line 659: > > ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > > Cheers >

Re: @Test(timeout = 1000)

+1 on increasing the timeouts for those to at least 10sec. On Mon, Apr 8, 2013 at 9:19 AM, Ted Yu wrote: > In trunk, I found 4 tests with such annotation. > They're all small tests. > > I guess the intention was that GC wouldn't be long in a test where cluster > is not spun up. > > I think incr

Re: Anyone know how to get surefire to list timed out tests?

Andy: Have you looked at how dev-support/test-patch.sh finds zombie tests ? It starts from line 659: ZOMBIE_TESTS_COUNT=`jps | grep surefirebooter | wc -l` if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then Cheers On Mon, Apr 8, 2013 at 7:09 PM, Andrew Purtell wrote: > I set up a freestyle project t

Re: Does compatibility between versions also mean binary compatibility?

I generally agree that we are not at the point of keeping binary or even source compatibility of Phoenix's use of RegionScanner's etc. In order to be very flexible, we are giving coprocessors too much control. For normal client-level API's, I am not convinced that we should keep binary compatibili

[jira] [Created] (HBASE-8302) HBase dynamic configuration

Brian Fu created HBASE-8302: --- Summary: HBase dynamic configuration Key: HBASE-8302 URL: https://issues.apache.org/jira/browse/HBASE-8302 Project: HBase Issue Type: Improvement Affects Versions:

[jira] [Created] (HBASE-8301) Document for hbase.rpc.timeout

Daisuke Kobayashi created HBASE-8301: Summary: Document for hbase.rpc.timeout Key: HBASE-8301 URL: https://issues.apache.org/jira/browse/HBASE-8301 Project: HBase Issue Type: Improvement

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #488

See Changes: [eclark] HBASE-8293 Move BigDecimalColumnInterpreter into hbase-client [sershe] HBASE-8248 HConnectionManager moved region tracking can cause the region server to redirect to itself; load balancer uses incorrec

Re: Anyone know how to get surefire to list timed out tests?

I set up a freestyle project to build by invoking maven out of a shell script. My guess is that will show the timed out tests as happens when run locally in a terminal. See http://54.241.6.143/job/HBase-0.94-Freestyle On Mon, Apr 8, 2013 at 5:45 PM, Andrew Purtell wrote: > See for example http:

[jira] [Created] (HBASE-8300) TestSplitTransaction fails to delete files due to open handles left when region is split

Malie Yin created HBASE-8300: Summary: TestSplitTransaction fails to delete files due to open handles left when region is split Key: HBASE-8300 URL: https://issues.apache.org/jira/browse/HBASE-8300 Projec

[jira] [Resolved] (HBASE-8037) RegionMovedException is handled incorrectly for multi-region requests that fail completely

[ https://issues.apache.org/jira/browse/HBASE-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HBASE-8037. - Resolution: Not A Problem Fixed by HBASE-8036 > RegionMovedException is

[jira] [Resolved] (HBASE-7236) add per-table/per-cf configuration via metadata

[ https://issues.apache.org/jira/browse/HBASE-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HBASE-7236. - Resolution: Fixed Fix Version/s: 0.95.0 Release Note: The ability to configur

Build failed in Jenkins: hbase-0.95-on-hadoop2 #61

See Changes: [eclark] HBASE-8293 Move BigDecimalColumnInterpreter into hbase-client [sershe] HBASE-8248 HConnectionManager moved region tracking can cause the region server to redirect to itself; load balancer uses incorrect serve

Anyone know how to get surefire to list timed out tests?

See for example http://54.241.6.143/job/HBase-0.94/71/console: [...] [JENKINS] Recording test results [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total ti

Re: Does compatibility between versions also mean binary compatibility?

Yes of course. On Sat, Apr 6, 2013 at 1:11 PM, James Taylor wrote: > That seems reasonable to make an exception for coprocessors on binary > compatibility. Can this be explicitly documented if it's not already so > folks are sure to know that? > -- Best regards, - Andy Problems worthy of

[jira] [Created] (HBASE-8299) ExploringCompactionPolicy can get stuck in rare cases.

Elliott Clark created HBASE-8299: Summary: ExploringCompactionPolicy can get stuck in rare cases. Key: HBASE-8299 URL: https://issues.apache.org/jira/browse/HBASE-8299 Project: HBase Issue Ty

Build failed in Jenkins: HBase-TRUNK #4044

See Changes: [eclark] HBASE-8293 Move BigDecimalColumnInterpreter into hbase-client [sershe] HBASE-8248 HConnectionManager moved region tracking can cause the region server to redirect to itself; load balancer uses incorrect servername c

Re: Declaring HBase Public API in 0.94

The advantage of the annotations is that Tom White already did the work for jdiff to ignore non-public classes over in Hadoop land. We could leverage that work, whether we re-use the o.a.h.classification annotations or add our own copies in org.apache.hbase.*. -Todd On Mon, Apr 8, 2013 at 3:08 PM

[jira] [Created] (HBASE-8298) desc shorthand for describe , similar to how databases have

Hari Sekhon created HBASE-8298: -- Summary: desc shorthand for describe , similar to how databases have Key: HBASE-8298 URL: https://issues.apache.org/jira/browse/HBASE-8298 Project: HBase Issue

[jira] [Created] (HBASE-8297) ClassFinder/IntegrationTestDriver errors are not helpful

Sergey Shelukhin created HBASE-8297: --- Summary: ClassFinder/IntegrationTestDriver errors are not helpful Key: HBASE-8297 URL: https://issues.apache.org/jira/browse/HBASE-8297 Project: HBase

Re: Declaring HBase Public API in 0.94

It seems we could just generally document that: - no RPC incompatibilities - no API breaking changes to any user facing classes (now we'll pay better attention to this) - best effort to keep coprocessor API changes backward compatible If - on the other hand - we wanted to automate API checks then

Re: Declaring HBase Public API in 0.94

> Given that it's only annotations, you also may be able to pull in the Hadoop 2 annotations package without all of common (I believe it's a separate maven artifact) I fear that will cause even more problems, since 0.94 will still be run against 0.23, and 2.x. I would vote for bringing the annotat

[jira] [Resolved] (HBASE-7954) Fix the retrying logic of memstore flushes to avoid extra sleep

[ https://issues.apache.org/jira/browse/HBASE-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Himanshu Vashishtha resolved HBASE-7954. Resolution: Invalid With HBASE-7507 rolled back, we no longer need this.

Re: Declaring HBase Public API in 0.94

There's always the option of duplicating those annotations into the HBase package if you want to annotate 0.94 without depending on Hadoop 2. Given that it's only annotations, you also may be able to pull in the Hadoop 2 annotations package without all of common (I believe it's a separate maven ar

Re: Declaring HBase Public API in 0.94

bq. Keeping 0.2x compatibility was something that was hard won in 0.94 True. We should maintain this status. On Mon, Apr 8, 2013 at 1:49 PM, Elliott Clark wrote: > Please don't pull in @InterfaceAudience. Keeping 0.2x compatibility was > something that was hard won in 0.94, it would be a real

[jira] [Created] (HBASE-8296) Add svn ignores to hbase-assembly

Elliott Clark created HBASE-8296: Summary: Add svn ignores to hbase-assembly Key: HBASE-8296 URL: https://issues.apache.org/jira/browse/HBASE-8296 Project: HBase Issue Type: Task Co

[jira] [Resolved] (HBASE-1774) HTable$ClientScanner modifies its input parameters

[ https://issues.apache.org/jira/browse/HBASE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-1774. -- Resolution: Won't Fix The Javadoc should suffice > HTable$ClientScanner modifi

Re: Declaring HBase Public API in 0.94

Please don't pull in @InterfaceAudience. Keeping 0.2x compatibility was something that was hard won in 0.94, it would be a real shame to loose that now. On Mon, Apr 8, 2013 at 11:07 AM, Aleksandr Shulman wrote: > Hi everyone, > > In light of all the conversation on compatibility, I wanted to fl

[jira] [Resolved] (HBASE-8288) HBaseFileSystem: Refactoring and correct semantics for createPath methods

[ https://issues.apache.org/jira/browse/HBASE-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matteo Bertozzi resolved HBASE-8288. Resolution: Fixed committed to 0.94. Thanks Himanshu for the patch and Nick for the review!

Re: Unable to build HBase trunk

You can find some details there: https://issues.apache.org/jira/browse/HBASE-8187 2013/4/8 Himanshu Vashishtha : > Add clean should help: > mvn clean package -DskipTests > > To create tar ball (which i find useful), > mvn clean install package assembly:single > > Thanks, > Himanshu > > > On Mon, A

Re: Unable to build HBase trunk

Add clean should help: mvn clean package -DskipTests To create tar ball (which i find useful), mvn clean install package assembly:single Thanks, Himanshu On Mon, Apr 8, 2013 at 12:27 PM, Varun Sharma wrote: > Hey, > > I am running "mvn package -DskipTests" on trunk and getting the following >

Re: Recording test results ERROR: Failed to archive test

Right, on the EC2 jenkins I had to increase the heap size of the slave host process itself, not our forked test JVMs. On Mon, Apr 8, 2013 at 10:32 AM, Stack wrote: > On Mon, Apr 8, 2013 at 8:29 AM, Nicolas Liochon wrote: > > > I was under the impression that it was a hudson/jenkins stack, not

Unable to build HBase trunk

Hey, I am running "mvn package -DskipTests" on trunk and getting the following error(s). This is not the entire trace. I am running from the top level directory. It seems that I am missing something which is obvious, here. ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plug

Re: Recording test results ERROR: Failed to archive test

It seems it's not related to the machines: on the failure above, 2 are on hadoop2, 1 or hadoop3, and it's the only one we used recently... On Mon, Apr 8, 2013 at 9:04 PM, Stack wrote: > Just saying, 3.4G to run tests is also obnoxious. We need to fix this > too. > St.Ack > > > On Mon, Apr

Re: Recording test results ERROR: Failed to archive test

Just saying, 3.4G to run tests is also obnoxious. We need to fix this too. St.Ack On Mon, Apr 8, 2013 at 12:02 PM, Stack wrote: > On Mon, Apr 8, 2013 at 10:40 AM, Nicolas Liochon wrote: > >> It seems random, but frequent: >> https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console

Re: Recording test results ERROR: Failed to archive test

On Mon, Apr 8, 2013 at 10:40 AM, Nicolas Liochon wrote: > It seems random, but frequent: > https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console > https://builds.apache.org/job/PreCommit-HBASE-Build/5182/console > https://builds.apache.org/job/PreCommit-HBASE-Build/5184/console > > In

Re: About distributed lock service in HBase

1. Yes the region servers can absolutely work while the master is down (for a while). Master is mostly there for administrative clean up duties ie, balancing, assigning and creating tables. Additionally there can be more than one master process running at a time. There's a leader election that t

[jira] [Created] (HBASE-8295) TestMasterFailover.testMasterFailoverWithMockedRITOnDeadRS is flaky.

rajeshbabu created HBASE-8295: - Summary: TestMasterFailover.testMasterFailoverWithMockedRITOnDeadRS is flaky. Key: HBASE-8295 URL: https://issues.apache.org/jira/browse/HBASE-8295 Project: HBase

[jira] [Created] (HBASE-8294) Make HBaseConfiguration a singleton class

Himanshu Vashishtha created HBASE-8294: -- Summary: Make HBaseConfiguration a singleton class Key: HBASE-8294 URL: https://issues.apache.org/jira/browse/HBASE-8294 Project: HBase Issue Typ

[jira] [Created] (HBASE-8293) Move RowProcessorClient and BigDecimalColumnInterpreter into hbase-client

Elliott Clark created HBASE-8293: Summary: Move RowProcessorClient and BigDecimalColumnInterpreter into hbase-client Key: HBASE-8293 URL: https://issues.apache.org/jira/browse/HBASE-8293 Project: HBas

[jira] [Resolved] (HBASE-8254) Add lz4 to test compression util usage string

[ https://issues.apache.org/jira/browse/HBASE-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-8254. -- Resolution: Fixed Fix Version/s: 0.95.1 Hadoop Flags: Reviewed Committed to trunk a

Declaring HBase Public API in 0.94

Hi everyone, In light of all the conversation on compatibility, I wanted to float the idea of documenting which Java packages, classes, and methods we want to declare as being API compatible in 0.94.x. I'd like your input on: 1. JavaDoc vs. using AudienceInterface 2. What the javadoc notation shou

[jira] [Created] (HBASE-8292) Online configuration updates

Amitanand Aiyer created HBASE-8292: -- Summary: Online configuration updates Key: HBASE-8292 URL: https://issues.apache.org/jira/browse/HBASE-8292 Project: HBase Issue Type: Improvement

Re: Recording test results ERROR: Failed to archive test

It seems random, but frequent: https://builds.apache.org/job/PreCommit-HBASE-Build/5181/console https://builds.apache.org/job/PreCommit-HBASE-Build/5182/console https://builds.apache.org/job/PreCommit-HBASE-Build/5184/console In 4955, I have errors related to maven (it seems the last version of su

Re: Recording test results ERROR: Failed to archive test

On Mon, Apr 8, 2013 at 8:29 AM, Nicolas Liochon wrote: > I was under the impression that it was a hudson/jenkins stack, not a maven > one? Pardon me. I reread the stack trace. Yeah, this is post-maven copying of results so yeah a jenkins issue. What I found in the past is that some of our te

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #487

See -- [...truncated 3710 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.442 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 2, Failures

Re: About distributed lock service in HBase

Brady: Hopefully Nicolas answered your questions. We do use zookeeper for coordinating table schema changes. See the following JIRA: HBASE-7305. ZK based Read/Write locks for table operations Cheers On Mon, Apr 8, 2013 at 8:34 AM, Nicolas Liochon wrote: > HBASE-5541 is about rowlock. The maste

Re: @Test(timeout = 1000)

In trunk, I found 4 tests with such annotation. They're all small tests. I guess the intention was that GC wouldn't be long in a test where cluster is not spun up. I think increasing the timeout should be fine. Cheers On Mon, Apr 8, 2013 at 9:10 AM, Nicolas Liochon wrote: > Hi, > > I see some

[jira] [Created] (HBASE-8291) ServerCallable should handle RegionMovedException

Nicolas Liochon created HBASE-8291: -- Summary: ServerCallable should handle RegionMovedException Key: HBASE-8291 URL: https://issues.apache.org/jira/browse/HBASE-8291 Project: HBase Issue Typ

@Test(timeout = 1000)

Hi, I see some tests with a test timeout of 1s. The problem with this is that it may happen with a GC or anything on the server. Any issue to decide to have a minimum of 60s for such settings? Thanks, Nicolas

Jenkins build is back to normal : HBase-TRUNK #4042

See

Re: About distributed lock service in HBase

HBASE-5541 is about rowlock. The master plays no role in this. This lock does not have to be distributed, because, in bigtable/hbase architecture, the rows are allocated to a single region / region server. This makes things faster. Nicolas On Mon, Apr 8, 2013 at 5:27 PM, Brady Zhong wrote: > H

Re: Recording test results ERROR: Failed to archive test

I was under the impression that it was a hudson/jenkins stack, not a maven one? But it's worth trying. On Mon, Apr 8, 2013 at 5:26 PM, Stack wrote: > I took a look at the jenkins config for precommit. > > > We are setting this environment variable: > > MAVEN_OPTS=-Xmx3G > > ... which should be

Re: About distributed lock service in HBase

Hi Nicolas, Thanks for your explanation. I know HBase uses ZeeKeeper as coordinated service but not a lock management service like Chubby. Like HBASE-5541 states, it seems the RegionServer controls the whole write process including providing row lock, region lock etc.. So I wonder why we don't use

Re: Recording test results ERROR: Failed to archive test

I took a look at the jenkins config for precommit. We are setting this environment variable: MAVEN_OPTS=-Xmx3G ... which should be big enough. I also see MAVEN_OPTS="-Xmx3g" in the test-patch.properties. In test-patch.sh, I see this being picked up. Should I change test-patch.sh so it pri

Recording test results ERROR: Failed to archive test

We've got a lot of errors in precommit that seems to be due to Jenkins needing more memory. It seems to be a Jenkins needing more memory. It seems that we don't have this on trunk, so it would be a difference of config between the two environments. Do you agree? Who could fix this (i.e. has the

Re: About distributed lock service in HBase

Hi, 1. Yes. Client applications can start/read/write even when there is no master. 2. HBase already uses ZooKeeper. You may want to have to look at the hbase reference guide ( http://hbase.apache.org/book.html). Nicolas On Mon, Apr 8, 2013 at 4:39 PM, Brady Zhong wrote: > Hi all, > > My name

[jira] [Created] (HBASE-8290) TestHTableMultiplexer is flaky

Nicolas Liochon created HBASE-8290: -- Summary: TestHTableMultiplexer is flaky Key: HBASE-8290 URL: https://issues.apache.org/jira/browse/HBASE-8290 Project: HBase Issue Type: Bug Co

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #486

See Changes: [zjushch] HBASE-8287 TestRegionMergeTransactionOnCluster failed in trunk build #4010 -- [...truncated 3704 lines...] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Ti

Build failed in Jenkins: HBase-TRUNK #4041

See -- [...truncated 3705 lines...] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.582 sec Running org.apache.hadoop.hbase.util.TestMergeTable Tests run: 1, Failures: 0, Errors: 0, Skipped

Build failed in Jenkins: hbase-0.95-on-hadoop2 #60

See Changes: [zjushch] HBASE-8287 TestRegionMergeTransactionOnCluster failed in trunk build #4010 -- [...truncated 4335 lines...] [DEBUG] Configuring mojo 'org.apache.maven.plugins:maven-si

Jenkins build is back to normal : HBase-TRUNK #4040

See

[jira] [Created] (HBASE-8289) TestThreads#testSleepWithoutInterrupt should not expect a bounded wait time

Nicolas Liochon created HBASE-8289: -- Summary: TestThreads#testSleepWithoutInterrupt should not expect a bounded wait time Key: HBASE-8289 URL: https://issues.apache.org/jira/browse/HBASE-8289 Project