[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823802#comment-16823802 ] Hudson commented on SUBMARINE-40: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16451 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/16451/]) SUBMARINE-40. Add TonY runtime to Submarine. Contributed by Keqiu Hu. (ztang: rev e79a9c12c14dcecc674048ed182e74d8690e663a) * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/buider/JobStatusBuilder.java * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/buider/package-info.java * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/site/resources/css/site.css * (add) hadoop-submarine/hadoop-submarine-tony-runtime/README.md * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyJobSubmitter.java * (edit) hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/RunJobParameters.java * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/package-info.java * (edit) hadoop-submarine/hadoop-submarine-yarnservice-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/yarnservice/YarnServiceJobSubmitter.java * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/test/java/TestTonyUtils.java * (edit) hadoop-submarine/hadoop-submarine-core/src/site/markdown/QuickStart.md * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyJobMonitor.java * (edit) hadoop-submarine/pom.xml * (edit) hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/CliConstants.java * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/site/markdown/QuickStart.md * (add) hadoop-submarine/hadoop-submarine-tony-runtime/pom.xml * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyUtils.java * (edit) hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/RunJobCli.java * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/site/site.xml * (add) hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyRuntimeFactory.java > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch, > SUBMARINE-40.005.patch, SUBMARINE-40.006.patch, SUBMARINE-40.007.patch, > SUBMARINE-40.008.patch, SUBMARINE-40.009.patch, SUBMARINE-40.010.patch, > SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823791#comment-16823791 ] Zhankun Tang commented on SUBMARINE-40: --- [~oliverhuh...@gmail.com], LGTM. +1. Committed to trunk. Thanks! > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch, > SUBMARINE-40.005.patch, SUBMARINE-40.006.patch, SUBMARINE-40.007.patch, > SUBMARINE-40.008.patch, SUBMARINE-40.009.patch, SUBMARINE-40.010.patch, > SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823764#comment-16823764
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
44s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
1s{color} | {color:green} No case conflicting files found. {color} |
| {color:blue}0{color} | {color:blue} markdownlint {color} | {color:blue} 0m
0s{color} | {color:blue} markdownlint was not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
32s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m
40s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
29s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 56s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
4s{color} | {color:green} trunk passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
32s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
54s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 14s{color} | {color:orange} hadoop-submarine: The patch generated 2 new + 25
unchanged - 0 fixed = 27 total (was 25) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
43s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 49s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m
13s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
51s{color} | {color:green} hadoop-submarine in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
32s{color} | {color:green} hadoop-submarine-core in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
30s{color} | {color:green} hadoop-submarine-yarnservice-runtime in the patch
passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
26s{color} | {color:green} hadoop-submarine-tony-runtime in the patch passed.
{color} |
| {color:green}+1{color} | {color:green}
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823712#comment-16823712
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 7m
44s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
1s{color} | {color:green} No case conflicting files found. {color} |
| {color:blue}0{color} | {color:blue} markdownlint {color} | {color:blue} 0m
0s{color} | {color:blue} markdownlint was not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
7s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 25m
34s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} trunk passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 19s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 44s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
21s{color} | {color:red} hadoop-submarine in trunk failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
35s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
17s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
30s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
29s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 29s{color}
| {color:red} hadoop-submarine in the patch failed. {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 13s{color} | {color:orange} hadoop-submarine: The patch generated 16 new +
20 unchanged - 0 fixed = 36 total (was 20) {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
33s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
19s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 4 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 20s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
11s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
48s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color}
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822993#comment-16822993 ] Zhankun Tang commented on SUBMARINE-40: --- [~oliverhuh...@gmail.com], this seems good to me. Some minor comments: 1. Could you please add the description of the possible values of "submarine.runtime.class"? Let's make it more clear what to configure here to use Tony runtime. 2. The QuickStart.md in TonY runtime seems incomplete. It has a " Notes:" in the end. 3. Please fix the trailing whitespaces and add the ASF license at the beginning of the QuickStart.md (You can refer to existing .md file) And for the mvn site, javadoc failure. I found the same issue on my local laptop. *But after I run "mvn install ...", the failure disappears.* For the findbug, I think it no longer exists. The failure in Jenkins should be caused by the same reason of "mvn site ..." and "mvn javadoc". [~sunilg], any suggestion on the mvn site failure, if the Jenkins can run the mvn install beforehand, this seems will pass. Can we resolve this in pom.xml? > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch, > SUBMARINE-40.005.patch, SUBMARINE-40.006.patch, SUBMARINE-40.007.patch, > SUBMARINE-40.008.patch, SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822942#comment-16822942
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
47s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 19m
21s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} trunk passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 19s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 37s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
19s{color} | {color:red} hadoop-submarine in trunk failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
35s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 14s{color} | {color:orange} hadoop-submarine: The patch generated 15 new +
19 unchanged - 0 fixed = 34 total (was 19) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
40s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 6 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 28s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
51s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
51s{color} | {color:green} hadoop-submarine in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
33s{color} | {color:green} hadoop-submarine-core in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
23s{color} | {color:green} hadoop-submarine-tony-runtime in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} unit {color} |
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818610#comment-16818610 ] Zhankun Tang commented on SUBMARINE-40: --- [~oliverhuh...@gmail.com] , the findbugs reports the same issues in my local after I import Submarine code as a separate project. Could you please check it? And also, could please you add the introduction and usage of TonY in doc, maybe QuickStart.md? > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch, > SUBMARINE-40.005.patch, SUBMARINE-40.006.patch, SUBMARINE-40.007.patch, > SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818601#comment-16818601 ] Zhankun Tang commented on SUBMARINE-40: --- [~oliverhuh...@gmail.com] , Thanks for the patch. The latest one looks good to me. Could you please fix the style issues? Like, add "package-info.java", comments. etc. The Jenkins seems has issues because it doesn't report the findbugs issue in my local. And it seems no javadoc plugin defined for the Submarine. [~sunilg] , any idea on the failed javadoc and mvnsite? > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch, > SUBMARINE-40.005.patch, SUBMARINE-40.006.patch, SUBMARINE-40.007.patch, > SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816154#comment-16816154
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
27s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
9s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 22m
20s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
29s{color} | {color:green} trunk passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 20s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 16s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
20s{color} | {color:red} hadoop-submarine in trunk failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
34s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
13s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
16s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 13s{color} | {color:orange} hadoop-submarine: The patch generated 34 new +
20 unchanged - 0 fixed = 54 total (was 20) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
11m 47s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
9s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
4s{color} | {color:red} hadoop-submarine generated 1 new + 0 unchanged - 0
fixed = 1 total (was 0) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
58s{color} | {color:green} hadoop-submarine in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
31s{color} | {color:green} hadoop-submarine-core in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
23s{color} | {color:green} hadoop-submarine-tony-runtime in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
30s{color} |
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816115#comment-16816115
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
41s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
1s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
7s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 24m
29s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} trunk passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 19s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 42s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
22s{color} | {color:red} hadoop-submarine in trunk failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
35s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
15s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine-core in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 17s{color}
| {color:red} hadoop-submarine in the patch failed. {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 13s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
20s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
19s{color} | {color:red} hadoop-submarine-core in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 45s{color} | {color:green} patch has no errors when building and
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815642#comment-16815642
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
50s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
9s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 24m
32s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
31s{color} | {color:green} trunk passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 19s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 42s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
21s{color} | {color:red} hadoop-submarine in trunk failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
34s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
16s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine-core in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
16s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 16s{color}
| {color:red} hadoop-submarine in the patch failed. {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 11s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
17s{color} | {color:red} hadoop-submarine-core in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
11s{color} | {color:red} hadoop-submarine-yarnservice-runtime in the patch
failed. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 39s{color} | {color:green} patch has no errors when building and
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815541#comment-16815541 ] Keqiu Hu commented on SUBMARINE-40: --- Uploaded [^SUBMARINE-40.005.patch] to rebase master > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch, > SUBMARINE-40.005.patch, SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815172#comment-16815172
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 7s{color}
| {color:red} SUBMARINE-40 does not apply to trunk. Rebase required? Wrong
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | SUBMARINE-40 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12965557/SUBMARINE-40.004.patch
|
| Console output |
https://builds.apache.org/job/PreCommit-SUBMARINE-Build/41/console |
| versions | git=1.9.1 |
| Powered by | Apache Yetus 0.10.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Add TonY runtime to Submarine
> -
>
> Key: SUBMARINE-40
> URL: https://issues.apache.org/jira/browse/SUBMARINE-40
> Project: Hadoop Submarine
> Issue Type: New Feature
>Affects Versions: 0.2.0
>Reporter: Keqiu Hu
>Assignee: Keqiu Hu
>Priority: Major
> Labels: submarine, tony
> Fix For: 0.2.0
>
> Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.004.patch,
> SUBMARINE-40.patch
>
> Original Estimate: 504h
> Remaining Estimate: 504h
>
> Currently Submarine depends on YARN native service, we need another runtime
> to support Hadoop versions w/o native service. Plan is to add a TonY runtime
> into Submarine eco system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815083#comment-16815083 ] Keqiu Hu commented on SUBMARINE-40: --- Thanks [~erwaman] for the review, updating them. > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.003.patch, SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804481#comment-16804481
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
24s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 17m
22s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
30s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
16s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
23s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
11m 31s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
52s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
55s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
14s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
27s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 13s{color} | {color:orange} hadoop-submarine: The patch generated 103 new +
24 unchanged - 0 fixed = 127 total (was 24) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
11m 31s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
30s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
19s{color} | {color:green} hadoop-submarine generated 0 new + 0 unchanged - 3
fixed = 0 total (was 3) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
15s{color} | {color:green} hadoop-submarine-core in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
16s{color} | {color:green}
hadoop-submarine_hadoop-submarine-yarnservice-runtime generated 0 new + 0
unchanged - 3 fixed = 0 total (was 3) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} hadoop-submarine-tony-runtime in the patch passed.
{color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
44s{color} | {color:green} hadoop-submarine in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
27s{color} | {color:green} hadoop-submarine-core in the patch passed. {color} |
|
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804479#comment-16804479
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
44s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
25s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 18m
48s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
28s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
19s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
35s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 56s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
44s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
58s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
21s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
57s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
25s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 16s{color} | {color:orange} hadoop-submarine: The patch generated 110 new +
24 unchanged - 0 fixed = 134 total (was 24) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
14m 55s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
51s{color} | {color:green} hadoop-submarine in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
27s{color} | {color:green} hadoop-submarine-core in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
31s{color} | {color:green} hadoop-submarine-yarnservice-runtime in the patch
passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
28s{color} | {color:green} hadoop-submarine-tony-runtime in the patch passed.
{color} |
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
30s{color} | {color:red} The patch generated 5 ASF License warnings.
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802426#comment-16802426 ] Sunil Govindan commented on SUBMARINE-40: - Thanks [~oliverhuh...@gmail.com] for the patch and appreciate the effort. > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarine, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797585#comment-16797585 ] Keqiu Hu commented on SUBMARINE-40: --- Yes, I'll update that. > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarin, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797586#comment-16797586 ] Keqiu Hu commented on SUBMARINE-40: --- Yes, I'll update that. > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarin, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797507#comment-16797507 ] Zhankun Tang commented on SUBMARINE-40: --- Thanks for the patch! [~oliverhuh...@gmail.com] . I took a quick look and it looks good to me. One minor question is that for yarn service runtime, there's a "--localizaiton" options to support user's requirement to make their files available in all containers. Is the "–container_resources" doing a similar thing here? > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarin, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794761#comment-16794761
]
Hadoop QA commented on SUBMARINE-40:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
23s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
1s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
5s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 21m
6s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
31s{color} | {color:green} trunk passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 22s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
19s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 40s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Skipped patched modules with no Java source:
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
23s{color} | {color:red} hadoop-submarine in trunk failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
18s{color} | {color:red} hadoop-submarine-yarnservice-runtime in trunk failed.
{color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
28s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
12s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
26s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 26s{color}
| {color:red} hadoop-submarine in the patch failed. {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 15s{color} | {color:orange} The patch fails to run checkstyle in
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
30s{color} | {color:red} hadoop-submarine in the patch failed. {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red} 0m
12s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
5s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
12m 26s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
0s{color} | {color:blue} Skipped patched modules with no Java source:
hadoop-submarine {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
15s{color} | {color:red} hadoop-submarine-tony-runtime in the patch failed.
{color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
22s{color} | {color:red} hadoop-submarine in the patch failed.
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[
https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794730#comment-16794730
]
Keqiu Hu commented on SUBMARINE-40:
---
Missing features:
- Quick links hook up.
- Tensorboard hook up.
The command I used to run:
{code:java}
CLASSPATH=$(hadoop classpath
--glob):./hadoop-submarine-core/target/hadoop-submarine-core-0.2.0-SNAPSHOT.jar:./hadoop-submarine-yarnservice-runtime/target/hadoop-submarine-score-yarnservice-runtime-0.2.0-SNAPSHOT.jar:./hadoop-submarine-tony-runtime/target/hadoop-submarine-tony-runtime-0.2.0-SNAPSHOT.jar:/home/pi/hadoop/TonY/tony-cli/build/libs/tony-cli-0.3.0-SNAPSHOT-all.jar
java org.apache.hadoop.yarn.submarine.client.cli.Cli job run --name tf-job-001
--verbose --docker_image hadoopsubmarine/tf-1.8.0-cpu:0.0.3--input_path
hdfs://pi-aw:9000/dataset/cifar-10-data --worker_resources memory=3G,vcores=2
--worker_launch_cmd "export CLASSPATH=\$(/hadoop-3.1.0/bin/hadoop classpath
--glob) && cd /test/models/tutorials/image/cifar10_estimator && python
cifar10_main.py --data-dir=%input_path% --job-dir=%checkpoint_path%
--train-steps=1 --eval-batch-size=16 --train-batch-size=16
--variable-strategy=CPU --num-gpus=0 --sync" --env
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 --env
DOCKER_HADOOP_HDFS_HOME=/hadoop-3.1.0 --env
DOCKER_JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 --container_resources
/home/pi/hadoop/TonY/tony-cli/build/libs/tony-cli-0.3.0-SNAPSHOT-all.jar --env
HADOOP_HOME=/hadoop-3.1.0 --env HADOOP_YARN_HOME=/hadoop-3.1.0 --env
HADOOP_COMMON_HOME=/hadoop-3.1.0 --env HADOOP_HDFS_HOME=/hadoop-3.1.0 --env
HADOOP_CONF_DIR=/hadoop-3.1.0/etc/hadoop
{code}
submarine.xml:
{code:java}
submarine.runtime.class/name>org.apache.hadoop.yarn.submarine.runtimes.tony.TonyRuntimeFactory
{code}
> Add TonY runtime to Submarine
> -
>
> Key: SUBMARINE-40
> URL: https://issues.apache.org/jira/browse/SUBMARINE-40
> Project: Hadoop Submarine
> Issue Type: New Feature
>Affects Versions: 0.2.0
>Reporter: Keqiu Hu
>Assignee: Keqiu Hu
>Priority: Major
> Labels: submarin, tony
> Fix For: 0.2.0
>
> Attachments: SUBMARINE-40.patch
>
> Original Estimate: 504h
> Remaining Estimate: 504h
>
> Currently Submarine depends on YARN native service, we need another runtime
> to support Hadoop versions w/o native service. Plan is to add a TonY runtime
> into Submarine eco system.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (SUBMARINE-40) Add TonY runtime to Submarine
[ https://issues.apache.org/jira/browse/SUBMARINE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794728#comment-16794728 ] Keqiu Hu commented on SUBMARINE-40: --- Uploaded initial patch. Tested locally: - With docker - Without docker Not tested - GPU (my local machine has no GPU..) - Keytab (TonY supports adding anything as a resource and use delegation token by default, not sure we need this). > Add TonY runtime to Submarine > - > > Key: SUBMARINE-40 > URL: https://issues.apache.org/jira/browse/SUBMARINE-40 > Project: Hadoop Submarine > Issue Type: New Feature >Affects Versions: 0.2.0 >Reporter: Keqiu Hu >Assignee: Keqiu Hu >Priority: Major > Labels: submarin, tony > Fix For: 0.2.0 > > Attachments: SUBMARINE-40.patch > > Original Estimate: 504h > Remaining Estimate: 504h > > Currently Submarine depends on YARN native service, we need another runtime > to support Hadoop versions w/o native service. Plan is to add a TonY runtime > into Submarine eco system. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
