[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759073#comment-16759073 ] Hudson commented on YARN-9231: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15870 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/15870/]) YARN-9231. TestDistributedShell fix timeout. Contributed by Prabhu (wwei: rev 69bcff380fbed5ed201706382a72baff1828910a) * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Fix For: 3.3.0 > > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759060#comment-16759060 ] Weiwei Yang commented on YARN-9231: --- Committed to trunk, thanks for getting this fixed [~Prabhu Joseph], and thanks for the review [~sunilg], [~yuan_zac]! > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Fix For: 3.3.0 > > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759051#comment-16759051 ] Weiwei Yang commented on YARN-9231: --- OK cool. I am going to commit with 1800 value and trigger a jenkins job for YARN-9231 to verify everything else. > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[
https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759041#comment-16759041
]
Prabhu Joseph commented on YARN-9231:
-
Yes Sure, Looks Test Results captures only Succeeded Test Cases. The console
output shows 16m 5s.
{code}
/usr/bin/mvn --batch-mode
-Dmaven.repo.local=/home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/yetus-m2/hadoop-trunk-patch-0
-Ptest-patch -Pparallel-tests -P!shelltest -Pnative -Drequire.fuse
-Drequire.openssl -Drequire.snappy -Drequire.valgrind -Drequire.test.libhadoop
-Pyarn-ui clean test -fae >
/testptch/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
2>&1
Elapsed: 16m 5s
hadoop-yarn-applications-distributedshell in the patch failed.
{code}
> TestDistributedShell fix timeout
>
>
> Key: YARN-9231
> URL: https://issues.apache.org/jira/browse/YARN-9231
> Project: Hadoop YARN
> Issue Type: Bug
> Components: distributed-shell
>Affects Versions: 3.1.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Attachments: 0001-YARN-9231.patch
>
>
> TestDistributedShell test cases time out with - "There was a timeout or other
> error in the fork"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759029#comment-16759029 ] Weiwei Yang commented on YARN-9231: --- Looks like the module hadoop-yarn-applications-distributedshell took 16 minutes. Can we set the value to 1800 (30 minutes)? That should be more than enough right? > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753700#comment-16753700 ] Sunil Govindan commented on YARN-9231: -- Thanks [~Prabhu Joseph] and [~yuan_zac] I think lets try with 2500 for now and see how jenkins is responding. Lets get this now. +1 > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753696#comment-16753696 ] Zac Zhou commented on YARN-9231: [~Prabhu Joseph] ， I run into the same problem. Thanks a lot for fixing it. LGTM, +1 But I'm not sure if 2500 seconds is ok. [~sunilg], any comments~ > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752342#comment-16752342 ] Prabhu Joseph commented on YARN-9231: - [~sunilg] Can you review this jira. TestDistributedShell testcases timing out as the configured timeout 15minutes is not sufficient. Have increased the timeout. > TestDistributedShell fix timeout > > > Key: YARN-9231 > URL: https://issues.apache.org/jira/browse/YARN-9231 > Project: Hadoop YARN > Issue Type: Bug > Components: distributed-shell >Affects Versions: 3.1.0 >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: 0001-YARN-9231.patch > > > TestDistributedShell test cases time out with - "There was a timeout or other > error in the fork" -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[
https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752331#comment-16752331
]
Hadoop QA commented on YARN-9231:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
15s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 20m
7s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
23s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
24s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
32m 3s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
15s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
21s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 23s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
14s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 16m
0s{color} | {color:green} hadoop-yarn-applications-distributedshell in the
patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
22s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 63m 39s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:8f97d6f |
| JIRA Issue | YARN-9231 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12956353/0001-YARN-9231.patch |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient xml |
| uname | Linux 5c0a4b37be43 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24
10:58:50 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 84bb980 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_191 |
| Test Results |
https://builds.apache.org/job/PreCommit-YARN-Build/23188/testReport/ |
| Max. process+thread count | 629 (vs. ulimit of 1) |
| modules | C:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell
U:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell
|
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/23188/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> TestDistributedShell fix timeout
>
>
> Key: YARN-9231
> URL: https://issues.apache.org/jira/browse/YARN-9231
> Project: Hadoop YARN
> Issue Type: Bug
> Components: distributed-shell
>Affects Versions: 3.1.0
>
[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout
[
https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752269#comment-16752269
]
Prabhu Joseph commented on YARN-9231:
-
On analysis - found there are more than 25 test cases and each average takes 30
seconds. Overall the test cases takes more than 15minutes. The
surefire.fork.timeout is set to 900 seconds and so Maven Surefire Plugin timing
out. Have increased the timeout to 2500 seconds for
hadoop-yarn-applications-distributedshell project.
{code}
2500
{code}
> TestDistributedShell fix timeout
>
>
> Key: YARN-9231
> URL: https://issues.apache.org/jira/browse/YARN-9231
> Project: Hadoop YARN
> Issue Type: Bug
> Components: distributed-shell
>Affects Versions: 3.1.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Attachments: 0001-YARN-9231.patch
>
>
> TestDistributedShell test cases time out with - "There was a timeout or other
> error in the fork"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
