Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2018-02-01 Thread Stack
All seems to have settled now. Hadoopqa is running 'normally' again with yetus 0.7.0 and some new configs (Thanks to Allen Wittenhauer for the help/input...). That said, we need to work on curbing resources used during test runs St.Ack On Wed, Jan 31, 2018 at 9:01 AM, Stack wrote: > I just s

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2018-01-31 Thread Stack
I just set hadoopqa to be 0.7.0 again with an upped proclimit to see if this fixes our OOME failures.. HadoopQA builds numbered 11295 and later will have this change. Thanks S On Wed, Jan 31, 2018 at 6:46 AM, Stack wrote: > Note that I reverted our yetus version last night. It discombobulated ou

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2018-01-31 Thread Stack
Note that I reverted our yetus version last night. It discombobulated our builds (OOMEs). Meantime, you'll have to do the patch naming trick for another day or so. Our test runs seem to use an ungodly number of file descriptors Stay tuned. S On Mon, Jan 29, 2018 at 10:56 PM, Stack wrote: > O

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2018-01-29 Thread Stack
Our brothers and sisters over in yetus-land made a release that deals w/ the changed JIRA behavior regards ordering attached-patches. No need of deleting all but the intended patch going forward nor gymnastics with prefixes when naming. It seems to be working properly. The one-liner change that mo

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-12-08 Thread Stack
Thanks Andrew. I disabled the job. Use the nightly going forward. The jdk7 builds seem to run fine. The jdk8 has some timeout going on. Need to dig in. You can see here: https://builds.apache.org/view/H-L/view/HBase/job/HBase%20Nightly/job/branch-1.4/ Thanks, M On Fri, Dec 8, 2017 at 11:29 AM, A

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-12-08 Thread Andrew Purtell
Ok with me, Stack. Thanks for asking. On Thu, Nov 30, 2017 at 5:33 PM, Stack wrote: > On the move over to nightly test runs: > > 1.2 nightly had a successful build last night after the branch-1 > stabilization effort (HBASE-19204) and fixing a few unit test failures. See > build 150 > https://b

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-30 Thread Stack
On the move over to nightly test runs: 1.2 nightly had a successful build last night after the branch-1 stabilization effort (HBASE-19204) and fixing a few unit test failures. See build 150 https://builds.apache.org/view/H-L/view/HBase/job/HBase%20Nightly/job/branch-1.2/ It then failed, 151, becau

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-29 Thread Apekshit Sharma
Oh, btw, flaky dashboard job needs to be changed now to use those builds instead. I'll try to give it sometime. On Wed, Nov 29, 2017 at 1:19 PM, Apekshit Sharma wrote: > Yeah, i liked that breakup a lot! One look, and you know which part needs > fixing. > fyi: It might take few seconds before

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-29 Thread Apekshit Sharma
Yeah, i liked that breakup a lot! One look, and you know which part needs fixing. fyi: It might take few seconds before the table we are talking about shows up. -- Appy On Wed, Nov 29, 2017 at 8:06 AM, Stack wrote: > Example of the new nice reporting: vhttps:// > builds.apache.org/view/H-L/v

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-29 Thread Stack
Example of the new nice reporting: vhttps:// builds.apache.org/view/H-L/view/HBase/job/HBase%20Nightly/job/branch-1.2/ S On Wed, Nov 29, 2017 at 8:06 AM, Stack wrote: > Note that I have disabled the HBase-1.2-JDK7, HBase-1.2-JDK8, > HBase-1.3-JDK7, and HBase-1.3-JDK8 jobs. They have been broken

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-29 Thread Stack
Note that I have disabled the HBase-1.2-JDK7, HBase-1.2-JDK8, HBase-1.3-JDK7, and HBase-1.3-JDK8 jobs. They have been broken for a good while now. In their place, refer to an ongoing Sean "Nightly" project, an effort he has been at for a while. It does more checking with pretty reports that will he

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-07 Thread Stack
On Tue, Nov 7, 2017 at 6:10 AM, Sean Busbey wrote: > > Should I be able to see the machine dir when I look at nightlies output? > > (Was trying to see what else is running). > > Ah. we don't have the same machine sampling on nightly as we do in > precommit. I am 80% on a patch for HBASE-19189 (ru

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-07 Thread Sean Busbey
okay, what gets saved from test runs is controlled by a parameter to the jenkins job called "ARCHIVE_PATTERN_LIST". That gets used by Apache Yetus' archival feature[1]. which is essentially a comma separated set of file name regexes to use with the find command. The default in the job is "TEST-*

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-07 Thread Sean Busbey
> Should I be able to see the machine dir when I look at nightlies output? > (Was trying to see what else is running). Ah. we don't have the same machine sampling on nightly as we do in precommit. I am 80% on a patch for HBASE-19189 (run test ad-hoc repeatedly) that includes pulling that informat

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-07 Thread Sean Busbey
surefire results get zipped up (we were filling the jenkins hosts with old test logs previously) and stored in a file called "test_logs.zip" for each jvm run. So if that happend in the jdk7 run for branch-1.2, it'd be in artifacts -> output-jdk7 -> test_logs.zip. I don't know if the archival proce

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-06 Thread Stack
I see this in the 1.2 nightly just when it gives up the ghost [WARNING] Corrupted STDOUT by directly writing to native stream in forked JVM 2. See FAQ web page and the dump file /testptch/hbase/hbase-server/target/surefire-reports/2017-11-06T20-11-30_219-jvmRun2.dumpstream .. but the pointed

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-06 Thread Stack
On Mon, Nov 6, 2017 at 8:35 AM, Sean Busbey wrote: > Given that all of the old post-commit tests have been posting that > they're failing to JIRAs for what looks like a month, is there any > reason not to switch to the new tests that also say they're failing? > > No reason. > The reason HBASE-

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-06 Thread Sean Busbey
Given that all of the old post-commit tests have been posting that they're failing to JIRAs for what looks like a month, is there any reason not to switch to the new tests that also say they're failing? The reason HBASE-18467 has been sitting on hold this whole time has been because the new nightl

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-06 Thread Sean Busbey
It looks like old tests branch-1.2 and branch-1.3 are failing with some maven enforcer problem that we thought we had fixed a few times before. It's probably fixable by changing the version of maven they use, but I'd much rather any test effort go into the last mile of getting our new nightly tests

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-11-06 Thread Stack
Our builds seem pretty sick up on builds.apache.org even after the miracle work by Allen W containing errant hadoop processes. Looking at 1.2 and 1.3, we don't even get off the ground. Anyone been taking a look? When I try to run the branch-1.2 and branch-1.3 unit tests locally, about ten tests or

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-08-21 Thread Stack
Loads of tests timing out in test runs -- then they all pass. Anyone have an input? I'm trying to take a look as background task... S On Tue, Jul 11, 2017 at 7:05 PM, Stack wrote: > Thanks Appy. > > Any one looking at the 'ERROR ExecutionException Java heap space...' > errors on patch builds or

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-11 Thread Stack
Thanks Appy. Any one looking at the 'ERROR ExecutionException Java heap space...' errors on patch builds or failed forking? Seems common enough. Here are complaints that remote JVM went away: https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/7617/artifact/patchprocess/patch-

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-10 Thread Apekshit Sharma
Fixed 'trends' in flaky dashboard. Since i changed the test names in last fix, the dots in the name were messing up with CSS selectors. :) On Mon, Jul 10, 2017 at 11:34 AM, Apekshit Sharma wrote: > Quick update on flaky dashboard: > Flaky dashboard wasn't working earlier because our trunk build

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-10 Thread Apekshit Sharma
Quick update on flaky dashboard: Flaky dashboard wasn't working earlier because our trunk build was broken. After trunk was fixed, the format of log lines in consoleText was not the same, so findHangingTests.py was not able to parse it correctly for broken/hanging/timeout tests. That's been fixed n

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-06 Thread Stack
On Thu, Jul 6, 2017 at 3:45 PM, Sean Busbey wrote: > that sounds like our project structure is broken. Please make sure there's > a jira that tracks it and I'll take a look later. > > Filed HBASE-18331 for now. I can take a look too later. St.Ack > On Thu, Jul 6, 2017 at 6:15 PM, Stack wro

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-06 Thread Sean Busbey
that sounds like our project structure is broken. Please make sure there's a jira that tracks it and I'll take a look later. On Thu, Jul 6, 2017 at 6:15 PM, Stack wrote: > I tried publishing hbase-3.0.0-SNAPSHOT... so hbase-checkstyle was up in > repo (presuming it relied on an aged-out snapshot

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-06 Thread Stack
I tried publishing hbase-3.0.0-SNAPSHOT... so hbase-checkstyle was up in repo (presuming it relied on an aged-out snapshot). Seems to have 'fixed' it for now St.Ack On Thu, Jul 6, 2017 at 12:50 PM, Stack wrote: > The 3.0.0-SNAPSHOT looks suspicious ... the hbase version > St.Ack > > On

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-06 Thread Stack
The 3.0.0-SNAPSHOT looks suspicious ... the hbase version St.Ack On Thu, Jul 6, 2017 at 12:49 PM, Stack wrote: > On Thu, Jul 6, 2017 at 12:48 PM, Stack wrote: > >> Checkstyle is currently broke on our builds... looking. >> St.Ack >> >> > Works if I run it locally (of course) > St.Ack > > >

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-06 Thread Stack
On Thu, Jul 6, 2017 at 12:48 PM, Stack wrote: > Checkstyle is currently broke on our builds... looking. > St.Ack > > Works if I run it locally (of course) St.Ack > > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-checkstyle-plugin:2.17:checkstyle > (default-cli) on projec

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-07-06 Thread Stack
Checkstyle is currently broke on our builds... looking. St.Ack [ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.17:checkstyle (default-cli) on project hbase: Execution default-cli of goal org.apache.maven.plugins:maven-checkstyle-plugin:2.17:checkstyle failed: Pl

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-30 Thread Sean Busbey
jacoco was added ages ago. I'd guess that something changed on the machines we use to cause it to stop working. On Thu, Jun 29, 2017 at 12:02 PM, Stack wrote: > On Wed, Jun 28, 2017 at 8:43 AM, Josh Elser wrote: > > > > > > > On 6/27/17 7:20 PM, Stack wrote: > > > >> * test-patch's whitespace p

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-29 Thread Stack
On Wed, Jun 28, 2017 at 8:43 AM, Josh Elser wrote: > > > On 6/27/17 7:20 PM, Stack wrote: > >> * test-patch's whitespace plugin can configured to ignore some files (but >>> I >>> can't think of any we'd care to so whitelist) >>> >>> Generated files. >> > > Oh my goodness, yes, please. This has be

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-28 Thread Josh Elser
On 6/27/17 7:20 PM, Stack wrote: * test-patch's whitespace plugin can configured to ignore some files (but I can't think of any we'd care to so whitelist) Generated files. Oh my goodness, yes, please. This has been such a pain in the rear for me as I've been rebasing space quota patches. S

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-27 Thread Stack
On Tue, Jun 27, 2017 at 10:28 AM, Sean Busbey wrote: > On Tue, Jun 27, 2017 at 11:38 AM, Stack wrote: > > > On Tue, Jun 27, 2017 at 9:24 AM, Sean Busbey wrote: > > > > > FYI, I've updated the precommit build to use Yetus 0.4.0 (which is the > > > current release). > > > > > > Shouldn't impact m

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-27 Thread Sean Busbey
On Tue, Jun 27, 2017 at 11:38 AM, Stack wrote: > On Tue, Jun 27, 2017 at 9:24 AM, Sean Busbey wrote: > > > FYI, I've updated the precommit build to use Yetus 0.4.0 (which is the > > current release). > > > > Shouldn't impact much. if things look off ping me. > > > > > Thanks Sean. > > Whats new

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-27 Thread Stack
On Tue, Jun 27, 2017 at 9:24 AM, Sean Busbey wrote: > FYI, I've updated the precommit build to use Yetus 0.4.0 (which is the > current release). > > Shouldn't impact much. if things look off ping me. > > Thanks Sean. Whats new in 0.4.0? S > On Wed, Mar 1, 2017 at 2:23 PM, Mikhail Antonov > w

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-06-27 Thread Sean Busbey
FYI, I've updated the precommit build to use Yetus 0.4.0 (which is the current release). Shouldn't impact much. if things look off ping me. On Wed, Mar 1, 2017 at 2:23 PM, Mikhail Antonov wrote: > Ouch. Thanks Sean! > > I'm pretty sure at some point I was debugging 1.3-IT job and saw branch-1.3

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-03-01 Thread Mikhail Antonov
Ouch. Thanks Sean! I'm pretty sure at some point I was debugging 1.3-IT job and saw branch-1.3 getting checked out in the logs. Not sure how/when it went sideways though. Yeah, let's see how it goes. -Mikhail On Wed, Mar 1, 2017 at 5:50 AM, Sean Busbey wrote: > Fun times. > > 1) Turns out our

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-03-01 Thread Sean Busbey
Fun times. 1) Turns out our 1.3-IT jobs have been running against branch-1.2. Don't know how long, but as long as we have history. 2) I deleted the failing-since-august 1.2-IT job. 3) I renamed the passing 1.3-IT job that runs against branch-1.2 to be the 1.2-IT job 4) I copied the now renamed

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2017-02-21 Thread Sean Busbey
FYI, I updated the 1.2-IT and 1.3-IT jobs today to use Appy's suggested "custom child workspace" of "${SHORT_COMBINATION}", since spaces in paths had caused them to fail for a v long time. On Fri, Oct 14, 2016 at 4:44 PM, Andrew Purtell wrote: > Thanks Ted, that would be a nice contribution, than

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-10-14 Thread Andrew Purtell
Thanks Ted, that would be a nice contribution, thank you. On Fri, Oct 14, 2016 at 12:07 PM, Apekshit Sharma wrote: > @Ted, here's the old jira, HBASE-14167. Use that. > > On Fri, Oct 14, 2016 at 12:02 PM, Ted Yu wrote: > > > I just ran the tests in hbase-spark module using 'mvn verify'. > > >

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-10-14 Thread Apekshit Sharma
@Ted, here's the old jira, HBASE-14167. Use that. On Fri, Oct 14, 2016 at 12:02 PM, Ted Yu wrote: > I just ran the tests in hbase-spark module using 'mvn verify'. > > All passed. > > I am testing a patch locally where hbase-spark tests are run in test phase. > > If the tests pass, I will log a J

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-10-14 Thread Ted Yu
I just ran the tests in hbase-spark module using 'mvn verify'. All passed. I am testing a patch locally where hbase-spark tests are run in test phase. If the tests pass, I will log a JIRA. Thanks > On Oct 14, 2016, at 11:41 AM, Andrew Purtell wrote: > > The hbase-spark integration tests

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-10-14 Thread Andrew Purtell
The hbase-spark integration tests run (and fail) for me locally whenever I build master with 'mvn clean install -DskipITs' . HBaseConnectionCacheSuite: - all test cases *** FAILED *** 2 did not equal 1 (HBaseConnectionCacheSuite.scala:92) Saw it but had to ignore/triage to get something else do

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-10-14 Thread Sean Busbey
Do the HBase Spark tests only run during the maven verify command? We'll need to update our personality to say that that command should be used for unit tests when in the hbase spark module. ugh. On Thu, Oct 13, 2016 at 7:42 PM, Apekshit Sharma wrote: > Our patch process isn't running hbase-spark

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-10-13 Thread Apekshit Sharma
Our patch process isn't running hbase-spark tests. See this for example: https://builds.apache.org/job/PreCommit-HBASE-Build/3842/ https://builds.apache.org/job/PreCommit-HBASE-Build/3842/artifact/patchprocess/patch-unit-hbase-spark.txt/*view*/ Found it when trying to debug cause of trunk failure

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-19 Thread Stack
childCustomWorkspace seems to be just the ticket. Nice find Appy. St.Ack On Mon, Sep 19, 2016 at 10:03 AM, Sean Busbey wrote: > Option 2c looks to be working really well. Thanks for tackling this Appy! > > We still have some failures on the master build, but it looks like > actual problems (or p

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-19 Thread Sean Busbey
Option 2c looks to be working really well. Thanks for tackling this Appy! We still have some failures on the master build, but it looks like actual problems (or perhaps a flakey). There are several passing builds. This should be pretty easy to replicate on the other jobs. I don't see a downside.

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-16 Thread Apekshit Sharma
So this all started with spaces-in-path issue, right? I think it has gobbled up a lot of time of a lot of people. Let's discuss our options and try to fix it for good. Here are what i can think of, and my opinion about them. 1. Not use matrix build Temporary fix. Not preferred since not

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-16 Thread Stack
The profile (or define) skipSparkTests looks like it will skip spark tests. Setting skipIntegrationTests to true will skip it. S On Fri, Sep 16, 2016 at 1:40 PM, Dima Spivak wrote: > Doesn't seem we need a matrix project for master anymore since we're just > doing JDK 8 now, right? Also, it look

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-16 Thread Dima Spivak
Doesn't seem we need a matrix project for master anymore since we're just doing JDK 8 now, right? Also, it looks like the hbase-spark integration-test phase is what's tripping up the build. Why not just temporarily disable that to unblock testing? On Friday, September 16, 2016, Apekshit Sharma wr

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-16 Thread Apekshit Sharma
So the issue is, we set JAVA_HOME to jdk8 based on matrix param and using tool environment. Since mvn uses the env variable, it compiles with jdk 8. But i suspect that scalatest isn't using the env variable, instead it might be directly using 'java' cmd, which can be jdk 7 or 8, and can vary by mac

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-16 Thread aman poonia
I am not sure if this will help. But it looks like it is because of version mismatch, that is, it is expecting JDK1.7 and we are compiling with jdk1.8. That means there is some library which has to be compiled with jdk8 or needs to be updated to a jdk8 compatible version. -- *With Regards:-* *Am

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-15 Thread Apekshit Sharma
Emm, can it be because scalatest tries to use a different java then that specified by JAVA_HOME (which is used to compile) On Thu, Sep 15, 2016 at 2:10 PM, Apekshit Sharma wrote: > Andeverything is back to red. > Because something is plaguing our builds again. :( > > If anyone knows what's p

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-15 Thread Dima Spivak
52.0 is Java 8. Sounds like the code was compiled to target a later version than is being used at runtime. Are we accidentally using JDK 7 to run dependencies built and deployed with JDK 8? -Dima On Thu, Sep 15, 2016 at 2:10 PM, Apekshit Sharma wrote: > Andeverything is back to red. > Becau

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-15 Thread Apekshit Sharma
Andeverything is back to red. Because something is plaguing our builds again. :( If anyone knows what's problem in this case, please reply on this thread, otherwise i'll try to fix it later sometime today. [INFO] *--- scalatest-maven-plugin:1.0:test (integration-test) @ hbase-spark --- * [36m

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-12 Thread Mikhail Antonov
Great work indeed! Agreed, occasional failed runs may not be that bad, but fairly regular failed runs ruin the idea of CI. Especially for released or otherwise supposedly stable branches. -Mikhail On Mon, Sep 12, 2016 at 4:53 PM, Sean Busbey wrote: > awesome work Appy! > > That's certainly goo

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-12 Thread Sean Busbey
awesome work Appy! That's certainly good news to hear. On Mon, Sep 12, 2016 at 2:14 PM, Apekshit Sharma wrote: > On a separate note: > Trunk had 8 green runs in last 3 days! ( > https://builds.apache.org/job/HBase-Trunk_matrix/) > This was due to fixing just the mass failures on trunk and no cha

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-12 Thread Stack
On Mon, Sep 12, 2016 at 2:14 PM, Apekshit Sharma wrote: > On a separate note: > Trunk had 8 green runs in last 3 days! ( > https://builds.apache.org/job/HBase-Trunk_matrix/) > Woah! > This was due to fixing just the mass failures on trunk and no change in > flaky infra. Which made me to conc

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-12 Thread Apekshit Sharma
On a separate note: Trunk had 8 green runs in last 3 days! ( https://builds.apache.org/job/HBase-Trunk_matrix/) This was due to fixing just the mass failures on trunk and no change in flaky infra. Which made me to conclude two things: 1. Flaky infra works. 2. It relies heavily on the post-commit bu

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-09-12 Thread Apekshit Sharma
@Sean, Mikhail: I found the alternate solution. Using user defined axis, tool environment and env variable injection. See latest diff to https://builds.apache.org/job/HBase-Trunk_matrix/ job for reference. On Tue, Aug 30, 2016 at 7:39 PM, Mikhail Antonov wrote: > FYI, I did the same for branch-

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-30 Thread Mikhail Antonov
FYI, I did the same for branch-1.3 builds. I've disabled hbase-1.3 and hbase-1.3-IT jobs and instead created https://builds.apache.org/job/HBase-1.3-JDK8 and https://builds.apache.org/job/HBase-1.3-JDK7 This should work for now until we figure out how to move forward. Thanks, Mikhail On Wed, A

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-17 Thread Sean Busbey
/me smacks forehead these replacement jobs, of course, also have special characters in their names which then show up in the working path. renaming them to skip spaces and parens. On Wed, Aug 17, 2016 at 1:34 PM, Sean Busbey wrote: > FYI, it looks like essentially our entire CI suite is red, pr

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-17 Thread Sean Busbey
FYI, I also disabled the following jobs that are failing: * HBase 1.2 IT * HBase-0.94 * HBase-0.94-JDK7 * HBase-0.94-on-Hadoop-2 * HBase-0.94-security * HBase-0.94.28 The first one, Stack has graciously volunteered to run locally for the RC. The rest are slated for removal in HBASE-16380 On Wed

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-17 Thread Sean Busbey
FYI, it looks like essentially our entire CI suite is red, probably due to parts of our codebase not tolerating spaces or other special characters in the working directory. I've made a stop-gap non-multi-configuration set of jobs for running unit tests for the 1.2 branch against JDK 7 and JDK 8:

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-10 Thread Sean Busbey
Ugh. I sent a reply to Gav on builds@ about maybe getting names that don't have spaces in them: https://lists.apache.org/thread.html/8ac03dc62f9d6862d4f3d5eb37119c9c73b4059aaa3ebba52fc63bb6@%3Cbuilds.apache.org%3E In the mean time, is this an issue we need file with Hadoop or something we need t

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-10 Thread Matteo Bertozzi
There are a bunch of builds that have most of the test failing. Example: https://builds.apache.org/job/HBase-Trunk_matrix/1392/jdk=JDK%201.7%20(latest),label=yahoo-not-h2/testReport/junit/org.apache.hadoop.hbase/TestLocalHBaseCluster/testLocalHBaseCluster/ from the stack trace looks like the prob

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-09 Thread Stack
Good on you Sean. S On Mon, Aug 8, 2016 at 9:43 PM, Sean Busbey wrote: > I updated all of our jobs to use the updated JDK versions from infra. > These have spaces in the names, and those names end up in our > workspace path, so try to keep an eye out. > > > > On Mon, Aug 8, 2016 at 10:42 AM, Sea

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-08 Thread Sean Busbey
I updated all of our jobs to use the updated JDK versions from infra. These have spaces in the names, and those names end up in our workspace path, so try to keep an eye out. On Mon, Aug 8, 2016 at 10:42 AM, Sean Busbey wrote: > running in docker is the default now. relying on the default docke

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-08 Thread Sean Busbey
running in docker is the default now. relying on the default docker image that comes with Yetus means that our protoc checks are failing[1]. [1]: https://issues.apache.org/jira/browse/HBASE-16373 On Sat, Aug 6, 2016 at 5:03 PM, Sean Busbey wrote: > Hi folks! > > this morning I merged the patch

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-08-06 Thread Sean Busbey
Hi folks! this morning I merged the patch that updates us to Yetus 0.3.0[1] and updated the precommit job appropriately. I also changed it to use one of the Java versions post the puppet changes to asf build. The last three builds look normal (#2975 - #2977). I'm gonna try running things in do

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-06-16 Thread Sean Busbey
FYI, today our precommit jobs started failing because our chosen jdk (1.7.0.79) disappeared (mentioned on HBASE-16032). Initially we were doing something wrong, namely directly referencing the jenkins build tools area without telling jenkins to give us an env variable that stated where the jdk is

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-19 Thread Sean Busbey
FYI, I updated the precommit job today to specify that only compile time checks should be done against jdks other than the primary jdk7 instance. On Mon, Mar 7, 2016 at 8:43 PM, Sean Busbey wrote: > I tested things out, and while YETUS-297[1] is present the default runs > all plugins that can do

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-19 Thread Stack
Thanks Sean. St.Ack On Wed, Mar 16, 2016 at 12:04 PM, Sean Busbey wrote: > FYI, I updated the precommit job today to specify that only compile time > checks should be done against jdks other than the primary jdk7 instance. > > On Mon, Mar 7, 2016 at 8:43 PM, Sean Busbey wrote: > > > I tested th

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-15 Thread Phil Yang
https://issues.apache.org/jira/browse/YETUS-334 2016-03-15 21:48 GMT+08:00 Sean Busbey : > No, that definitely looks like a bug. Could you please open an issue on the > YETUS jira with a link to the relevant builds and HBASE jiras? > > On Tue, Mar 15, 2016 at 5:44 AM, Phil Yang wrote: > > > Hi a

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-15 Thread Sean Busbey
No, that definitely looks like a bug. Could you please open an issue on the YETUS jira with a link to the relevant builds and HBASE jiras? On Tue, Mar 15, 2016 at 5:44 AM, Phil Yang wrote: > Hi all, > > Recently pre-commit builds seems run some commands twice. For example, in > console of http

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-15 Thread Phil Yang
Hi all, Recently pre-commit builds seems run some commands twice. For example, in console of https://builds.apache.org/job/PreCommit-HBASE-Build/975/console or https://builds.apache.org/job/PreCommit-HBASE-Build/978/console , we run "Patch findbugs detection", "Patch javadoc verification", "Runn

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-14 Thread Stack
https://issues.apache.org/jira/browse/HBASE-15462 Thanks Sean. Looks like a version parse error? St.Ack On Mon, Mar 14, 2016 at 12:55 PM, Sean Busbey wrote: > HBASE please, I'll refile to INFRA or wherever if I can figure out the > source. > > On Mon, Mar 14, 2016 at 12:44 PM, Stack wrote:

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-14 Thread Sean Busbey
HBASE please, I'll refile to INFRA or wherever if I can figure out the source. On Mon, Mar 14, 2016 at 12:44 PM, Stack wrote: > On Mon, Mar 14, 2016 at 12:23 PM, Sean Busbey wrote: > > > is there a jira I can track for the docker failures? > > > > > No. All recent hadoopqas fail. Want an INFRA

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-14 Thread Stack
On Mon, Mar 14, 2016 at 12:23 PM, Sean Busbey wrote: > is there a jira I can track for the docker failures? > > No. All recent hadoopqas fail. Want an INFRA or HBASE issue? Thanks, St.Ack > On Mon, Mar 14, 2016 at 11:08 AM, Stack wrote: > > > Thanks for making the job configuration all nice a

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-14 Thread Sean Busbey
is there a jira I can track for the docker failures? On Mon, Mar 14, 2016 at 11:08 AM, Stack wrote: > Thanks for making the job configuration all nice and tidy BTW Sean. > > I unchecked RUN_IN_DOCKER just now to try and get us over current bout of > docker build failures. > > St.Ack > > > > On M

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-14 Thread Stack
Thanks for making the job configuration all nice and tidy BTW Sean. I unchecked RUN_IN_DOCKER just now to try and get us over current bout of docker build failures. St.Ack On Mon, Mar 7, 2016 at 10:27 AM, Sean Busbey wrote: > FYI, I've just updated our precommit jobs to use the 0.2.0 release

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-08 Thread Sean Busbey
On Mon, Mar 7, 2016 at 7:42 PM, Mikhail Antonov wrote: > Cutting 1.5 hours off pre-commit build's time would be great. Would > post-commit builds also only run on jdk7 or both? > > The post-commit builds are matrix builds that do the different JDKs in parallel. The JDKs picked are based on what w

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-07 Thread Mikhail Antonov
Cutting 1.5 hours off pre-commit build's time would be great. Would post-commit builds also only run on jdk7 or both? Mikhail On Mon, Mar 7, 2016 at 7:37 PM, Ted Yu wrote: > Running against jdk 7 only is fine by me. > > > On Mar 7, 2016, at 6:43 PM, Sean Busbey wrote: > > > > I tested things o

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-07 Thread Ted Yu
Running against jdk 7 only is fine by me. > On Mar 7, 2016, at 6:43 PM, Sean Busbey wrote: > > I tested things out, and while YETUS-297[1] is present the default runs all > plugins that can do multiple jdks against those available (jdk7 and jdk8 in > our case). > > We can configure things to o

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-07 Thread Sean Busbey
I tested things out, and while YETUS-297[1] is present the default runs all plugins that can do multiple jdks against those available (jdk7 and jdk8 in our case). We can configure things to only do a single run of unit tests. They'll be against jdk7, since that is our default jdk. That fine by eve

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-07 Thread Stack
Hurray! It looks like YETUS-96 is in there and we are only running on jdk build now, the default (but testing compile against both) Will keep an eye. St.Ack On Mon, Mar 7, 2016 at 10:27 AM, Sean Busbey wrote: > FYI, I've just updated our precommit jobs to use the 0.2.0 release of Yetus >

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-03-07 Thread Sean Busbey
FYI, I've just updated our precommit jobs to use the 0.2.0 release of Yetus that came out today. After keeping an eye out for strangeness today I'll turn docker mode back on by default tonight. On Wed, Jan 13, 2016 at 10:14 AM, Sean Busbey wrote: > FYI, I added a new parameter to the precommit

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-22 Thread stack
Thank you Sean (and Andrew) St.Ack On Jan 22, 2016 10:12 PM, "Sean Busbey" wrote: > Andrew in infra made us a label that covers all the hosts save H2. > I've updated all the nightly builds to use it. > > (specifying a label expression as we do in precommit doesn't work on > matrix builds because

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-22 Thread Sean Busbey
Andrew in infra made us a label that covers all the hosts save H2. I've updated all the nightly builds to use it. (specifying a label expression as we do in precommit doesn't work on matrix builds because the & and | from the expression end up in the filesystem path) On Fri, Jan 22, 2016 at 3:08

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-22 Thread Sean Busbey
we should probably ensure the earlier branch builds also exclude H2. I'll leave myself a note to look at it this evening. If anyone gets to it before then, please update here. On Fri, Jan 22, 2016 at 1:33 PM, Stack wrote: > Related to the below, I just changed the trunk matrix build job to excl

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-22 Thread Stack
Related to the below, I just changed the trunk matrix build job to exclude H2 from the build roster (with Sean's help); it seems to be responsible for this failure type -- *Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0* -- in particular. Here is recent example: https://builds.ap

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-19 Thread Sean Busbey
On Tue, Jan 19, 2016 at 11:48 AM, Stack wrote: > On Tue, Jan 19, 2016 at 5:46 AM, Sean Busbey wrote: > > > We could start forcing a clean repository on every build (though this > > seems heavy handed). > > > > IIRC, we ran into this ages ago and it was one particular dependency. > > Presuming we

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-19 Thread Stack
On Tue, Jan 19, 2016 at 5:46 AM, Sean Busbey wrote: > We could start forcing a clean repository on every build (though this > seems heavy handed). > > IIRC, we ran into this ages ago and it was one particular dependency. > Presuming we can track down what that was, we could add some pre-build > w

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-19 Thread Sean Busbey
We could start forcing a clean repository on every build (though this seems heavy handed). IIRC, we ran into this ages ago and it was one particular dependency. Presuming we can track down what that was, we could add some pre-build work that verifies a known good copy of that dependency is present

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-18 Thread Stack
Anyone know what the refresh timeout is for the below? We seem to be in a phase where we have a bad pom and the hadoop test builds are failing. Can we force refresh of the local repository by doing something like a custom build run? Thanks, St.Ack P.S. Here is what I am talking about: https://buil

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-13 Thread Sean Busbey
FYI, I added a new parameter to the precommit job: * USE_YETUS_PRERELEASE - causes us to use the HEAD of the apache/yetus repo rather than our chosen release It defaults to inactive, but can be used in manually-triggered runs to test a solution to a problem in the yetus library. At the moment, I'

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-11 Thread Sean Busbey
Found the problem (not setting the path to commands in the case where there is a cached install :/ ); have now turned off debug by default. On Mon, Jan 11, 2016 at 9:18 AM, Sean Busbey wrote: > We've had a few precommit jobs fail because the cache for our yetus > install was present but not execu

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-11 Thread Sean Busbey
We've had a few precommit jobs fail because the cache for our yetus install was present but not executable. I've turned on debugging so we can try to figure out what's going on the next time one happens. On Fri, Jan 8, 2016 at 7:58 AM, Sean Busbey wrote: > FYI, I just pushed HBASE-13525 (switch

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2016-01-08 Thread Sean Busbey
FYI, I just pushed HBASE-13525 (switch to Apache Yetus for precommit tests) and updated our jenkins precommit build to use it. Jenkins job has some explanation: https://builds.apache.org/view/PreCommit%20Builds/job/PreCommit-HBASE-Build/ Release note from HBASE-13525 does as well. The old job wi

  1   2   >