[GitHub] sanha opened a new pull request #74: [NEMO-141] Make vertices receiving push edge not comply executor slot

2018-07-10 Thread GitBox
sanha opened a new pull request #74: [NEMO-141] Make vertices receiving push edge not comply executor slot URL: https://github.com/apache/incubator-nemo/pull/74 JIRA: [NEMO-141: Make vertices receiving push edge not comply executor slot](https://issues.apache.org/jira/projects/NEMO/issues/

[GitHub] wynot12 commented on issue #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on issue #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#issuecomment-404042300 One more request. Multiple jobs mean multiple _pipelines_ in Beam and multiple _actions_ in Spark, right?

[GitHub] johnyangk commented on issue #71: [NEMO-55] Handle NCS Master-to-Executor RPC failures

2018-07-10 Thread GitBox
johnyangk commented on issue #71: [NEMO-55] Handle NCS Master-to-Executor RPC failures URL: https://github.com/apache/incubator-nemo/pull/71#issuecomment-403994990 @seojangho I've resolved the conflict with the master This is

[GitHub] johnyangk closed pull request #72: [NEMO-59] Skewed data-aware executor allocation

2018-07-10 Thread GitBox
johnyangk closed pull request #72: [NEMO-59] Skewed data-aware executor allocation URL: https://github.com/apache/incubator-nemo/pull/72 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201415610 ## File path: runtime/driver/src/main/java/edu/snu/nemo/driver/NemoDriver.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201409044 ## File path: runtime/common/src/main/java/edu/snu/nemo/runtime/common/metric/StateTran

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201426474 ## File path: runtime/master/src/main/java/edu/snu/nemo/runtime/master/scheduler/BatchS

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201398973 ## File path: common/src/main/java/edu/snu/nemo/common/ir/vertex/transform/Transform.ja

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201423203 ## File path: runtime/master/src/main/java/edu/snu/nemo/runtime/master/JobStateManager.

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201426548 ## File path: runtime/master/src/test/java/edu/snu/nemo/runtime/master/scheduler/TaskRe

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201409021 ## File path: runtime/common/src/main/java/edu/snu/nemo/runtime/common/metric/StateMetr

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201408343 ## File path: examples/spark/src/test/java/edu/snu/nemo/examples/spark/MRJava.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201426540 ## File path: runtime/master/src/test/java/edu/snu/nemo/runtime/master/scheduler/BatchS

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201423085 ## File path: runtime/master/src/main/java/edu/snu/nemo/runtime/master/MetricStore.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201414667 ## File path: runtime/driver/src/main/java/edu/snu/nemo/driver/NemoDriver.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201400646 ## File path: examples/spark/src/main/java/edu/snu/nemo/examples/spark/JavaWordAndLineC

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201423187 ## File path: runtime/executor/src/test/java/edu/snu/nemo/runtime/executor/datatransfer

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201413602 ## File path: runtime/driver/src/main/java/edu/snu/nemo/driver/NemoDriver.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201408352 ## File path: examples/spark/src/test/java/edu/snu/nemo/examples/spark/MRJava.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201409508 ## File path: runtime/common/src/main/proto/ControlMessage.proto ## @@ -38,8 +

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201417206 ## File path: client/src/main/java/edu/snu/nemo/client/JobLauncher.java ## @@

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201420338 ## File path: client/src/main/java/edu/snu/nemo/client/JobLauncher.java ## @@

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201426495 ## File path: runtime/master/src/main/java/edu/snu/nemo/runtime/master/scheduler/Schedu

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201398829 ## File path: client/src/main/java/edu/snu/nemo/client/JobLauncher.java ## @@

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201412732 ## File path: runtime/driver/src/main/java/edu/snu/nemo/driver/NemoDriver.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201412158 ## File path: runtime/driver/src/main/java/edu/snu/nemo/driver/NemoDriver.java

[GitHub] wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on a change in pull request #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#discussion_r201409141 ## File path: runtime/common/src/main/java/edu/snu/nemo/runtime/common/plan/PhysicalPla

[GitHub] wynot12 commented on issue #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program

2018-07-10 Thread GitBox
wynot12 commented on issue #73: [Nemo-62] Support Multiple Jobs Submission in a Single User Program URL: https://github.com/apache/incubator-nemo/pull/73#issuecomment-403883374 [Nemo-152](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-152?filter=allopenissues) is for executing m

[GitHub] wynot12 edited a comment on issue #69: [NEMO-2, 106, 117] Remove the /tests directory

2018-07-10 Thread GitBox
wynot12 edited a comment on issue #69: [NEMO-2, 106, 117] Remove the /tests directory URL: https://github.com/apache/incubator-nemo/pull/69#issuecomment-403849869 @wonook I've sent some commits that remove /runtime/test module with minor relocation of tests. But compiler-tests are s

[GitHub] wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory

2018-07-10 Thread GitBox
wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory URL: https://github.com/apache/incubator-nemo/pull/69#issuecomment-403849869 @wonook I've sent some commits that remove /runtime/test module with minor relocation of tests. But compiler-tests are still ind

[GitHub] jeongyooneo commented on issue #72: [NEMO-59] Skewed data-aware executor allocation

2018-07-10 Thread GitBox
jeongyooneo commented on issue #72: [NEMO-59] Skewed data-aware executor allocation URL: https://github.com/apache/incubator-nemo/pull/72#issuecomment-403743460 @johnyangk Thank you for the comments! I've addressed them. For skewness information in HashRange, I'll tackle it with [NEMO-1

[GitHub] wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory

2018-07-10 Thread GitBox
wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory URL: https://github.com/apache/incubator-nemo/pull/69#issuecomment-403727665 I know that the package dependency of PR is not clear, but it's because of the design of existing tests. I believe this PR is better

[GitHub] wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory

2018-07-10 Thread GitBox
wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory URL: https://github.com/apache/incubator-nemo/pull/69#issuecomment-403727192 I'll resolve conflicts soon. This is an automated message from the Apa

[GitHub] wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory

2018-07-10 Thread GitBox
wynot12 commented on issue #69: [NEMO-2, 106, 117] Remove the /tests directory URL: https://github.com/apache/incubator-nemo/pull/69#issuecomment-403726944 @wonook Thanks for review and suggestion! First, I didn't know `plangenerator` module is also for tests, since it's name is conf

[GitHub] johnyangk commented on issue #71: [NEMO-55] Handle NCS Master-to-Executor RPC failures

2018-07-10 Thread GitBox
johnyangk commented on issue #71: [NEMO-55] Handle NCS Master-to-Executor RPC failures URL: https://github.com/apache/incubator-nemo/pull/71#issuecomment-403724851 Thanks @seojangho I've addressed your comment. This is an aut

[GitHub] johnyangk closed pull request #62: [NEMO-71] Add NodeNamesAssignmentPass and Example Application

2018-07-10 Thread GitBox
johnyangk closed pull request #62: [NEMO-71] Add NodeNamesAssignmentPass and Example Application URL: https://github.com/apache/incubator-nemo/pull/62 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance