[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578504#comment-16578504
]
Allen Wittenauer commented on HDFS-12711:
-
bq. Was a follow up jira filed for this work? (and if
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578258#comment-16578258
]
Ewan Higgs commented on HDFS-12711:
---
{quote}2. hadoop-hdfs-project either needs to get refactored into
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259536#comment-16259536
]
Allen Wittenauer commented on HDFS-12711:
-
FYI HADOOP-13514.
> deadly hdfs test
>
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257668#comment-16257668
]
Allen Wittenauer commented on HDFS-12711:
-
Doing some quick math, my estimation is that we
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257558#comment-16257558
]
Allen Wittenauer commented on HDFS-12711:
-
bq. We usually try to rerun the failed tests locally to
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257363#comment-16257363
]
Arpit Agarwal commented on HDFS-12711:
--
I don't think committers are ignoring precommit run results.
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256584#comment-16256584
]
Allen Wittenauer commented on HDFS-12711:
-
Ignoring the hs_err_pid log files is pretty much just
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256368#comment-16256368
]
Erik Krogen commented on HDFS-12711:
Thanks Sean. Agreed that it is not really a big issue but it does
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256295#comment-16256295
]
Erik Krogen commented on HDFS-12711:
Yeah so although we obviously need to fix the unit tests, the
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256283#comment-16256283
]
Allen Wittenauer commented on HDFS-12711:
-
It's probably also worth pointing out that those files
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256275#comment-16256275
]
Allen Wittenauer commented on HDFS-12711:
-
Those files are the stack dumps from the unit tests
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256166#comment-16256166
]
Erik Krogen commented on HDFS-12711:
Hey [~aw], in addition to the wild fluctuations in success of
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251809#comment-16251809
]
Allen Wittenauer commented on HDFS-12711:
-
With the kill code in place, I'm seeing wild
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249035#comment-16249035
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249032#comment-16249032
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238181#comment-16238181
]
stack commented on HDFS-12711:
--
bq. For now, though, I'm sort of tired at looking at this problem and will go
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238107#comment-16238107
]
Allen Wittenauer commented on HDFS-12711:
-
Thanks!
I'll have to play around with sending a
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238056#comment-16238056
]
stack commented on HDFS-12711:
--
This is excellent work.
Would a kill -QUIT before you do actual kill of the
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237685#comment-16237685
]
Allen Wittenauer commented on HDFS-12711:
-
Finally got a full qbt run on branch-2, thanks to
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226299#comment-16226299
]
Allen Wittenauer commented on HDFS-12711:
-
For those playing at home:
YETUS-570 (in development)
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226133#comment-16226133
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225562#comment-16225562
]
Sean Busbey commented on HDFS-12711:
interesting. what's the spread on surefire versions for hadoops?
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224389#comment-16224389
]
Allen Wittenauer commented on HDFS-12711:
-
SUREFIRE-524 ?
> deadly hdfs test
>
>
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224146#comment-16224146
]
Allen Wittenauer commented on HDFS-12711:
-
I've got a hypothesis.
Somewhere in the HDFS code base
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223845#comment-16223845
]
Allen Wittenauer commented on HDFS-12711:
-
YETUS-570-wip-01 w/minor output fix test run.
> deadly
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223483#comment-16223483
]
Allen Wittenauer commented on HDFS-12711:
-
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223251#comment-16223251
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223191#comment-16223191
]
Allen Wittenauer commented on HDFS-12711:
-
bq. Max. thread count 3114
5000 proc limit is
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223185#comment-16223185
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222841#comment-16222841
]
Allen Wittenauer commented on HDFS-12711:
-
Adding some better metrics gathering for YETUS-561 so
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221741#comment-16221741
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221701#comment-16221701
]
Allen Wittenauer commented on HDFS-12711:
-
1500 is too strict. Trying 3000.
> deadly hdfs test
>
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221685#comment-16221685
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221587#comment-16221587
]
Allen Wittenauer commented on HDFS-12711:
-
For reference later, two branch-2 patches running on
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221575#comment-16221575
]
Allen Wittenauer commented on HDFS-12711:
-
This is a patch that I know how well it performs in
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221500#comment-16221500
]
Allen Wittenauer commented on HDFS-12711:
-
Some status, after taking part of the afternoon to do
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221229#comment-16221229
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221083#comment-16221083
]
Allen Wittenauer commented on HDFS-12711:
-
Note to self:
Kicking off another run with proclimit
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221077#comment-16221077
]
Allen Wittenauer commented on HDFS-12711:
-
Success!
One interesting thing: surefire is a liar.
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221076#comment-16221076
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221069#comment-16221069
]
Allen Wittenauer commented on HDFS-12711:
-
https://builds.apache.org/job/PreCommit-HDFS-Build2/2
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219757#comment-16219757
]
Allen Wittenauer commented on HDFS-12711:
-
Ok, at least locally, YETUS-561.04 is successfully
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219641#comment-16219641
]
Allen Wittenauer commented on HDFS-12711:
-
lol yeah, that's... too many.
OK, I know what I need
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219618#comment-16219618
]
Íñigo Goiri commented on HDFS-12711:
Almost a hundred java processes hanging around.
> deadly hdfs
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219587#comment-16219587
]
Allen Wittenauer commented on HDFS-12711:
-
See how many java processes are on that JDK7 node.
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219573#comment-16219573
]
Íñigo Goiri commented on HDFS-12711:
[~aw] just to confirm, I just run the unit tests with OpenJDK 8
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219512#comment-16219512
]
Allen Wittenauer commented on HDFS-12711:
-
For reference:
{code}
$ free -h
total
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219501#comment-16219501
]
Allen Wittenauer commented on HDFS-12711:
-
OK, I just hit it here. On my laptop's Linux VM, things
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219475#comment-16219475
]
Allen Wittenauer commented on HDFS-12711:
-
pono just provided this ps from one of the dead nodes:
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219416#comment-16219416
]
Allen Wittenauer commented on HDFS-12711:
-
FYI:
Reducing the number of nodes that HDFS, HADOOP,
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219365#comment-16219365
]
Allen Wittenauer commented on HDFS-12711:
-
Something else worth mentioning that I failed to
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219353#comment-16219353
]
Allen Wittenauer commented on HDFS-12711:
-
Re-launched the agent using the Jenkins UI. But now
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219295#comment-16219295
]
Allen Wittenauer commented on HDFS-12711:
-
Uh that was unexpected.
According to Jenkins,
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219285#comment-16219285
]
Hadoop QA commented on HDFS-12711:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219243#comment-16219243
]
Allen Wittenauer commented on HDFS-12711:
-
OK, messing with OOM from the docker perspective is NOT
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219178#comment-16219178
]
stack commented on HDFS-12711:
--
Rah rah [~aw]! Thanks for digging in.
> deadly hdfs test
>
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219103#comment-16219103
]
Allen Wittenauer commented on HDFS-12711:
-
Total run time was a bit over an hour. Much easier now
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219099#comment-16219099
]
Allen Wittenauer commented on HDFS-12711:
-
Hooray it crashed!
> deadly hdfs test
>
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219020#comment-16219020
]
Allen Wittenauer commented on HDFS-12711:
-
The problem that we're seeing is that if we run the
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219009#comment-16219009
]
Anu Engineer commented on HDFS-12711:
-
[~aw] [~daryn] [~kihwal] Care to enlighten us lesser souls
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218997#comment-16218997
]
Íñigo Goiri commented on HDFS-12711:
[~aw] the unit tests seemed to be running a week ago with Java 8.
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218914#comment-16218914
]
Allen Wittenauer commented on HDFS-12711:
-
FWIW, my current hypothesis is that we're triggering a
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218895#comment-16218895
]
Allen Wittenauer commented on HDFS-12711:
-
BTW, there a bunch of tests that still use
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218892#comment-16218892
]
Kihwal Lee commented on HDFS-12711:
---
bq. -1 on adding Skynet logic to the hdfs tests.
+2 to make it +1.
[
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218869#comment-16218869
]
Daryn Sharp commented on HDFS-12711:
-1 on adding Skynet logic to the hdfs tests.
> deadly hdfs test
65 matches
Mail list logo
