[
https://issues.apache.org/jira/browse/SUBMARINE-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883230#comment-16883230
]
Hadoop QA commented on SUBMARINE-66:
------------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
14s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 2 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 24m
42s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
40s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 15s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine-yarnservice-runtime {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 15s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 12m
51s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
12s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 12s{color}
| {color:red} hadoop-submarine-yarnservice-runtime in the patch failed. {color}
|
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 8s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine-yarnservice-runtime {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 10s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
14s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
14s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 14s{color}
| {color:red} hadoop-submarine-yarnservice-runtime in the patch failed. {color}
|
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
29s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 55m 42s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=18.09.7 Server=18.09.7 base:
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/Dockerfile
|
| JIRA Issue | SUBMARINE-66 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12974425/SUBMARINE-66.003.patch
|
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient findbugs checkstyle |
| uname | Linux be6eaa347ca7 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3
08:28:49 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/hadoop.sh |
| git revision | trunk / 5747f6c |
| Default Java | 1.8.0_212 |
| compile |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/branch-compile-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| checkstyle |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out//home/jenkins/jenkins-slave/workspace/PreCommit-SUBMARINE-Build/out/maven-branch-checkstyle-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| mvnsite |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/branch-mvnsite-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| javadoc |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/branch-javadoc-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| findbugs |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/branch-findbugs-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| mvninstall |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-mvninstall-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| compile |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-compile-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| javac |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-compile-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| checkstyle |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out//home/jenkins/jenkins-slave/workspace/PreCommit-SUBMARINE-Build/out/maven-patch-checkstyle-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| mvnsite |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-mvnsite-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| javadoc |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-javadoc-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| findbugs |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-findbugs-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| unit |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/artifact/out/patch-unit-hadoop-submarine_hadoop-submarine-yarnservice-runtime.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/testReport/ |
| Max. process+thread count | 311 (vs. ulimit of 5500) |
| modules | C: hadoop-submarine/hadoop-submarine-yarnservice-runtime U:
hadoop-submarine/hadoop-submarine-yarnservice-runtime |
| Console output |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/154/console |
| versions | git=2.7.4 maven=3.3.9 |
| Powered by | Apache Yetus 0.10.0 http://yetus.apache.org |
This message was automatically generated.
> Improve TF config env JSON generator + tests
> --------------------------------------------
>
> Key: SUBMARINE-66
> URL: https://issues.apache.org/jira/browse/SUBMARINE-66
> Project: Hadoop Submarine
> Issue Type: Improvement
> Reporter: Szilard Nemeth
> Assignee: Adam Antal
> Priority: Major
> Attachments: SUBMARINE-66.001.patch, SUBMARINE-66.002.patch,
> SUBMARINE-66.002.patch, SUBMARINE-66.003.patch
>
>
> org.apache.hadoop.yarn.submarine.runtimes.yarnservice.tensorflow.TensorFlowCommons#getTFConfigEnv
> generates a JSON of the TF_CONFIG environment variable.
> This code could be improved to use a JSON serializer instead of hand-crafting
> JSON data.
> The test class of this class also could be improved:
> org.apache.hadoop.yarn.submarine.runtimes.yarnservice.TestTFConfigGenerator
> In this class, there are some quite unreadable JSON strings, this could be
> refactored to be read out from a file instead.
> TestTFConfigGenerator has only one testcase and it's ugly, as we use very
> long strings to verify the JSON data produced matches our expected JSON.
> We should use JSON files instead of manually constructing Strings in tests,
> especially if they are very long.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)