[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065404#comment-15065404
]
Jonathan Hsieh commented on HBASE-14420:
Great stuff Stack.
> Zombie Stomping Session
>
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064410#comment-15064410
]
stack commented on HBASE-14420:
---
Link to set of flaky tests.
> Zombie Stomping Session
>
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037451#comment-15037451
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}.
{color:green}+1 core
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024722#comment-15024722
]
stack commented on HBASE-14420:
---
In 1.3 build, saw this just now in
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023783#comment-15023783
]
stack commented on HBASE-14420:
---
Just saw this over in branch-1.3, a hang on these:
kalashnikov:hbase.git
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996322#comment-14996322
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14996104#comment-14996104
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987414#comment-14987414
]
stack commented on HBASE-14420:
---
Latest is that we were still killing legit tests as zombies. See
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985983#comment-14985983
]
stack commented on HBASE-14420:
---
Here are the longest running tests:
{code}$ grep -h "
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984886#comment-14984886
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14982054#comment-14982054
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975137#comment-14975137
]
stack commented on HBASE-14420:
---
Have to refine our zombie terminology. There are zombies, tests that stick
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974796#comment-14974796
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973007#comment-14973007
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965502#comment-14965502
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962921#comment-14962921
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964049#comment-14964049
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964294#comment-14964294
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964346#comment-14964346
]
stack commented on HBASE-14420:
---
Trunk is looking good now reliably building all green if patch is good.
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962163#comment-14962163
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961987#comment-14961987
]
stack commented on HBASE-14420:
---
Says:
{code}
laked tests:
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961989#comment-14961989
]
stack commented on HBASE-14420:
---
TestDataBlockEncoders was doing 10k random seeks... cut it down to 1k.
>
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961804#comment-14961804
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961218#comment-14961218
]
Dima Spivak commented on HBASE-14420:
-
Hm, interesting, [~stack]. Jenkins has a [flaky test handler
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961225#comment-14961225
]
stack commented on HBASE-14420:
---
[~dimaspivak] That plugin looks nice. We've done the first part, enabling
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961245#comment-14961245
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961143#comment-14961143
]
stack commented on HBASE-14420:
---
[~dimaspivak] What to do about flakies? In patch build, we retry flakies
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960264#comment-14960264
]
stack commented on HBASE-14420:
---
On the TestBytes fail...
{code}
Fetching
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960281#comment-14960281
]
Elliott Clark commented on HBASE-14420:
---
So far once out of four today.
I saw this on the failed
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960286#comment-14960286
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960495#comment-14960495
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960950#comment-14960950
]
stack commented on HBASE-14420:
---
FYI [~dimaspivak] ... You are trying to follow along... see above where my
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959798#comment-14959798
]
Elliott Clark commented on HBASE-14420:
---
TestBytes is a small test that doesn't even start another
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960209#comment-14960209
]
stack commented on HBASE-14420:
---
bq. TestBytes is a small test that doesn't even start another thread ( I
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959237#comment-14959237
]
stack commented on HBASE-14420:
---
Report on last 10 hanging tests:
{code}
1 Hanging test :
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956532#comment-14956532
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957563#comment-14957563
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958153#comment-14958153
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956763#comment-14956763
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954644#comment-14954644
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955437#comment-14955437
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952679#comment-14952679
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953735#comment-14953735
]
stack commented on HBASE-14420:
---
This failure was odd:
{code}
kalashnikov:hbase.git stack$ python
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953739#comment-14953739
]
stack commented on HBASE-14420:
---
It did this:
{code}
[INFO] Rat check: Summary of files. Unapproved: 0
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954216#comment-14954216
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954022#comment-14954022
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953798#comment-14953798
]
Elliott Clark commented on HBASE-14420:
---
Mostly awesome.
> Zombie Stomping Session
>
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952092#comment-14952092
]
stack commented on HBASE-14420:
---
Looking at last 30 hadoop qa runs, these are which hung and failed:
1
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951291#comment-14951291
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950672#comment-14950672
]
Elliott Clark commented on HBASE-14420:
---
Want me to take a look ? I've got a little bit of time.
>
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950666#comment-14950666
]
stack commented on HBASE-14420:
---
TestSnapshotCloneIndependence fails pretty regularly:
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950837#comment-14950837
]
stack commented on HBASE-14420:
---
Thanks [~eclark]... I pinged the fellows responsible but they might take
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950865#comment-14950865
]
Elliott Clark commented on HBASE-14420:
---
Yeah I think it's a decent test ( though looking at it
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950930#comment-14950930
]
stack commented on HBASE-14420:
---
Here is report on what failed in last ten hadoopqa runs:
1 Hanging
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950999#comment-14950999
]
stack commented on HBASE-14420:
---
TestReplicaWithCluster#testReplicaAndReplication timedout here:
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949413#comment-14949413
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947556#comment-14947556
]
stack commented on HBASE-14420:
---
Report on last 10 runs of 1.2 hanging tests with 1.7 jvm:
1 Hanging
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947863#comment-14947863
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947155#comment-14947155
]
stack commented on HBASE-14420:
---
So patch build is tending blue now (it shows red on some recent runs
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947392#comment-14947392
]
Hadoop QA commented on HBASE-14420:
---
{color:red}-1 overall{color}. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947404#comment-14947404
]
stack commented on HBASE-14420:
---
Says:
Fetching
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946308#comment-14946308
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945672#comment-14945672
]
stack commented on HBASE-14420:
---
Going over the last 40 patch builds:
TestReplicationShell hangs three
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945611#comment-14945611
]
stack commented on HBASE-14420:
---
Master and branch-1 pass on my internal rig reliably without leaving
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946135#comment-14946135
]
stack commented on HBASE-14420:
---
Looks like we are getting somewhere with my no-change patch. Let me rerun.
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14946114#comment-14946114
]
Hadoop QA commented on HBASE-14420:
---
{color:green}+1 overall{color}. Here are the results of testing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945948#comment-14945948
]
stack commented on HBASE-14420:
---
Looking at trunk builds, I see these failures in last twenty builds:
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940734#comment-14940734
]
stack commented on HBASE-14420:
---
These seem to spin up loads of threads and processes:
Hanging test :
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936458#comment-14936458
]
stack commented on HBASE-14420:
---
Master runs on my rig are stable now. On to branch-1 runs.
Just saw these
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909102#comment-14909102
]
stack commented on HBASE-14420:
---
Rig is running smooth now. Passes all the time (6 servers building
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905393#comment-14905393
]
stack commented on HBASE-14420:
---
Oh, there are two tests named TestWithDisabledAuthorization -- one in
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905373#comment-14905373
]
stack commented on HBASE-14420:
---
So, after some git bisecting on branch-1, I see that HBASE-14290 "Spin up
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905436#comment-14905436
]
stack commented on HBASE-14420:
---
Reopening HBASE-14378 to apply a version of the patch that was over there.
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905455#comment-14905455
]
stack commented on HBASE-14420:
---
Committing this linked issue should help w/ branch-1 zombies.
> Zombie
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905596#comment-14905596
]
stack commented on HBASE-14420:
---
Back to my rig running against master, this has failed twice for me:
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876733#comment-14876733
]
stack commented on HBASE-14420:
---
Looking at recent builds, not bad but then this on ubuntu-1 doing
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876617#comment-14876617
]
stack commented on HBASE-14420:
---
bq. Otherwise stuff is generally passing
So, now focus moves back to
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876614#comment-14876614
]
stack commented on HBASE-14420:
---
On my test rig, got these failures in recent runs:
Failed tests:
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14743736#comment-14743736
]
stack commented on HBASE-14420:
---
Over w/e, after the TestFastFail* and balancer changes, my test runs have
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14743911#comment-14743911
]
stack commented on HBASE-14420:
---
Looking at recent zombie run on apache, I see these failures in
[
https://issues.apache.org/jira/browse/HBASE-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742190#comment-14742190
]
stack commented on HBASE-14420:
---
Of note, adding timeouts on sessions or doing it at the test class level
81 matches
Mail list logo