[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227851#comment-15227851 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58659020 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/SpillableFactory.java --- @@ -0,0 +1,171 @@ +/* + * Copyrig

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227848#comment-15227848 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58658808 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/Serde.java --- @@ -0,0 +1,42 @@ +/* + * Copyright 2016 Apach

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58658309 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/Serde.java --- @@ -0,0 +1,42 @@ +/* + * Copyright 2016 Apach

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227845#comment-15227845 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227844#comment-15227844 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58658226 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/Serde.java --- @@ -0,0 +1,42 @@ +/* + * Copyright 2016 Apach

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227836#comment-15227836 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58657819 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/SpillableFactory.java --- @@ -0,0 +1,171 @@ +/* + * Copyrig

[jira] [Closed] (APEXMALHAR-2014) ParquetReader operator

2016-04-05 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar closed APEXMALHAR-2014. - Resolution: Done Fix Version/s: 3.4.0 Work completed on this task. Par

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227828#comment-15227828 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58657579 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/SpillableFactory.java --- @@ -0,0 +1,171 @@ +/* + * Copyrig

[jira] [Commented] (APEXMALHAR-2014) ParquetReader operator

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227827#comment-15227827 ] ASF GitHub Bot commented on APEXMALHAR-2014: Github user asfgit closed th

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227831#comment-15227831 ] ASF GitHub Bot commented on APEXMALHAR-2046: Github user chandnisingh com

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2014 added parquet ...

2016-04-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/230 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread chandnisingh
Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/232#discussion_r58657541 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/spillable/SpillableFactory.java --- @@ -0,0 +1,171 @@ +/* + * Copyrig

[jira] [Commented] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227820#comment-15227820 ] ASF GitHub Bot commented on APEXMALHAR-2046: GitHub user ilooner opened a

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2046 #resolve #comm...

2016-04-05 Thread ilooner
GitHub user ilooner opened a pull request: https://github.com/apache/incubator-apex-malhar/pull/232 APEXMALHAR-2046 #resolve #comment adding spillable data structures fa… …ctory interface. You can merge this pull request into a Git repository by running: $ git pull https://

[jira] [Created] (APEXMALHAR-2046) Create SpillableFactory Interface

2016-04-05 Thread Timothy Farkas (JIRA)
Timothy Farkas created APEXMALHAR-2046: -- Summary: Create SpillableFactory Interface Key: APEXMALHAR-2046 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2046 Project: Apache Apex Malhar

[jira] [Assigned] (APEXCORE-340) Rename dtcli script to apex

2016-04-05 Thread Chinmay Kolhatkar (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar reassigned APEXCORE-340: -- Assignee: Chinmay Kolhatkar > Rename dtcli script to apex > -

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Yogi Devendra
Thumb rule for import order: As you go down the import order; you have more and more control over making changes to that code. Considering this idea, separation of org.apache.apex makes sense. +1 for org.apache.apex +0 separating api imports. ~ Yogi On 6 April 2016 at 11:19, Thomas Weise wrot

[jira] [Commented] (APEXMALHAR-2026) Spooled Datastructures

2016-04-05 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227780#comment-15227780 ] Thomas Weise commented on APEXMALHAR-2026: -- Ability to work with byte[] is i

[jira] [Commented] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227774#comment-15227774 ] ASF GitHub Bot commented on APEXCORE-421: - Github user ilooner commented on the

[GitHub] incubator-apex-core pull request: APEXCORE-421 #comment #resolve F...

2016-04-05 Thread ilooner
Github user ilooner commented on the pull request: https://github.com/apache/incubator-apex-core/pull/296#issuecomment-206129344 @sandeshh I agree, the problem is that this code is quite complex and there is almost no unit test coverage. I am afraid to do refactoring on code I don't

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Thomas Weise
Just wanted to know why, I have no preference. On Tue, Apr 5, 2016 at 10:48 PM, Chandni Singh wrote: > We treated com.datatorrent in a special way earlier which is why I started > the discussion. > If we don't want to have anything special for org.apache.apex then there > will not be any change.

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Chandni Singh
We treated com.datatorrent in a special way earlier which is why I started the discussion. If we don't want to have anything special for org.apache.apex then there will not be any change. Chandni On Tue, Apr 5, 2016 at 10:18 PM, Thomas Weise wrote: > Why do we need something special for org.apa

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Thomas Weise
Why do we need something special for org.apache.apex ? On Tue, Apr 5, 2016 at 10:15 PM, Chandni Singh wrote: > +1 for Ram's suggestion :-) > > On Tue, Apr 5, 2016 at 5:18 PM, Munagala Ramanath > wrote: > > > I'd suggest keeping all the org.apache imports together and in > > lexicographic order

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Chandni Singh
+1 for Ram's suggestion :-) On Tue, Apr 5, 2016 at 5:18 PM, Munagala Ramanath wrote: > I'd suggest keeping all the org.apache imports together and in > lexicographic order. > > Ram > > On Tue, Apr 5, 2016 at 5:12 PM, Chandni Singh > wrote: > > > Hi, > > > > We need to include org.apache.apex in

[jira] [Commented] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227736#comment-15227736 ] ASF GitHub Bot commented on APEXCORE-421: - Github user sandeshh commented on the

[GitHub] incubator-apex-core pull request: APEXCORE-421 #comment #resolve F...

2016-04-05 Thread sandeshh
Github user sandeshh commented on the pull request: https://github.com/apache/incubator-apex-core/pull/296#issuecomment-206120906 If the checkpoint function is not properly used in 3 places, it is time to fix that as well. --- If your project is set up for it, you can reply to this

[jira] [Commented] (APEXCORE-415) Input Operator Can Double Checkpoint if Operator CheckpointWindowCount is greater than DAG CheckpointWindowCount

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227725#comment-15227725 ] ASF GitHub Bot commented on APEXCORE-415: - Github user ilooner closed the pull r

[GitHub] incubator-apex-core pull request: APEXCORE-415 #resolve #comment F...

2016-04-05 Thread ilooner
Github user ilooner closed the pull request at: https://github.com/apache/incubator-apex-core/pull/295 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[jira] [Commented] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227720#comment-15227720 ] ASF GitHub Bot commented on APEXCORE-421: - Github user ilooner commented on the

[GitHub] incubator-apex-core pull request: APEXCORE-421 #comment #resolve F...

2016-04-05 Thread ilooner
Github user ilooner commented on the pull request: https://github.com/apache/incubator-apex-core/pull/296#issuecomment-206118367 @davidyan74 please review. There was another double checkpointing bug in InputNode which was causing my unit test to fail on travis. --- If your project i

[jira] [Commented] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227717#comment-15227717 ] Timothy Farkas commented on APEXCORE-421: - This bug was causing my double checkp

[jira] [Commented] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227714#comment-15227714 ] ASF GitHub Bot commented on APEXCORE-421: - GitHub user ilooner opened a pull req

[GitHub] incubator-apex-core pull request: APEXCORE-421 #comment #resolve F...

2016-04-05 Thread ilooner
GitHub user ilooner opened a pull request: https://github.com/apache/incubator-apex-core/pull/296 APEXCORE-421 #comment #resolve Fixing double checkpoint bug on InputN… …ode shutdown You can merge this pull request into a Git repository by running: $ git pull https://github

[jira] [Created] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread Timothy Farkas (JIRA)
Timothy Farkas created APEXCORE-421: --- Summary: Double Checkpointing May Happen In Input Node On Shutdown Key: APEXCORE-421 URL: https://issues.apache.org/jira/browse/APEXCORE-421 Project: Apache Apex

[jira] [Commented] (APEXCORE-421) Double Checkpointing May Happen In Input Node On Shutdown

2016-04-05 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227706#comment-15227706 ] Timothy Farkas commented on APEXCORE-421: - this is related to APEXCORE-415 > Do

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Munagala Ramanath
I'd suggest keeping all the org.apache imports together and in lexicographic order. Ram On Tue, Apr 5, 2016 at 5:12 PM, Chandni Singh wrote: > Hi, > > We need to include org.apache.apex in the import order that we have right > now: > > *Current order:* > java > javax > org > org.apache > io > c

Re: Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Chandni Singh
Also I think it will be a good idea to segregate api imports: *Proposed order:* java javax org org.apache io com com.datatorrent.api com.datatorrent org.apache.apex.api org.apache.apex * all static imports On Tue, Apr 5, 2016 at 5:12 PM, Chandni Singh wrote: > Hi, > > We need to include org.ap

Checkstyle import order needs to accomodate org.apache.apex

2016-04-05 Thread Chandni Singh
Hi, We need to include org.apache.apex in the import order that we have right now: *Current order:* java javax org org.apache io com com.datatorrent * all static imports *Proposed order:* java javax org org.apache io com com.datatorrent org.apache.apex * all static imports Thanks, Chandni

[jira] [Commented] (APEXCORE-411) Restart app without specifying app package

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227348#comment-15227348 ] ASF GitHub Bot commented on APEXCORE-411: - GitHub user davidyan74 reopened a pul

[GitHub] incubator-apex-core pull request: APEXCORE-411 support restarting ...

2016-04-05 Thread davidyan74
Github user davidyan74 closed the pull request at: https://github.com/apache/incubator-apex-core/pull/294 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[jira] [Commented] (APEXCORE-411) Restart app without specifying app package

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227347#comment-15227347 ] ASF GitHub Bot commented on APEXCORE-411: - Github user davidyan74 closed the pul

[GitHub] incubator-apex-core pull request: APEXCORE-411 support restarting ...

2016-04-05 Thread davidyan74
GitHub user davidyan74 reopened a pull request: https://github.com/apache/incubator-apex-core/pull/294 APEXCORE-411 support restarting app without app package or jar files @tweise please review You can merge this pull request into a Git repository by running: $ git pull https:/

[jira] [Commented] (APEXCORE-415) Input Operator Can Double Checkpoint if Operator CheckpointWindowCount is greater than DAG CheckpointWindowCount

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227326#comment-15227326 ] ASF GitHub Bot commented on APEXCORE-415: - GitHub user ilooner opened a pull req

[GitHub] incubator-apex-core pull request: APEXCORE-415 #resolve #comment F...

2016-04-05 Thread ilooner
GitHub user ilooner opened a pull request: https://github.com/apache/incubator-apex-core/pull/295 APEXCORE-415 #resolve #comment Fixed double checkpointing bug in Inpu… …tNode. You can merge this pull request into a Git repository by running: $ git pull https://github.com/i

[jira] [Updated] (APEXMALHAR-2037) Pluggable component to queue tuples with ability to spool to disk

2016-04-05 Thread Ashwin Chandra Putta (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Chandra Putta updated APEXMALHAR-2037: - Description: There are many use cases in which we are writing tuples

Re: proposal for reconciled JDBC output operator

2016-04-05 Thread Ashwin Chandra Putta
This can be done as a pluggable component that can be reused in existing output operators. The component will have a queue to buffer the regular flow of tuples and back it using WAL (APEXMALHAR-1965) when external system is slow or down. Will start a thread on the design soon. Regards, Ashwin. On

[jira] [Updated] (APEXMALHAR-2037) Pluggable component to queue tuples with ability to spool to disk

2016-04-05 Thread Ashwin Chandra Putta (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Chandra Putta updated APEXMALHAR-2037: - Summary: Pluggable component to queue tuples with ability to spool to

[GitHub] incubator-apex-core pull request: APEXCORE-10 #resolve Changes for...

2016-04-05 Thread ishark
Github user ishark commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/250#discussion_r58623950 --- Diff: api/src/main/java/com/datatorrent/api/AffinityRule.java --- @@ -0,0 +1,153 @@ +/** + * Licensed to the Apache Software Foundation

[jira] [Commented] (APEXCORE-10) Enable non-affinity of operators per node (not containers)

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227257#comment-15227257 ] ASF GitHub Bot commented on APEXCORE-10: Github user ishark commented on a diff i

[jira] [Commented] (APEXCORE-10) Enable non-affinity of operators per node (not containers)

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227226#comment-15227226 ] ASF GitHub Bot commented on APEXCORE-10: Github user tweise commented on a diff i

[GitHub] incubator-apex-core pull request: APEXCORE-10 #resolve Changes for...

2016-04-05 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/250#discussion_r58622624 --- Diff: api/src/main/java/com/datatorrent/api/DAG.java --- @@ -250,6 +250,24 @@ public abstract void setAttribute(Operator operator, Attr

[jira] [Commented] (APEXCORE-415) Input Operator Can Double Checkpoint if Operator CheckpointWindowCount is greater than DAG CheckpointWindowCount

2016-04-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227217#comment-15227217 ] David Yan commented on APEXCORE-415: [~timothyfarkas] we might want to cherry pick t

[jira] [Resolved] (APEXCORE-415) Input Operator Can Double Checkpoint if Operator CheckpointWindowCount is greater than DAG CheckpointWindowCount

2016-04-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXCORE-415. Resolution: Fixed Fix Version/s: 3.4.0 > Input Operator Can Double Checkpoint if Operator C

[jira] [Commented] (APEXCORE-10) Enable non-affinity of operators per node (not containers)

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227206#comment-15227206 ] ASF GitHub Bot commented on APEXCORE-10: Github user tweise commented on a diff i

[GitHub] incubator-apex-core pull request: APEXCORE-10 #resolve Changes for...

2016-04-05 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/250#discussion_r58620829 --- Diff: api/src/main/java/com/datatorrent/api/AffinityRule.java --- @@ -0,0 +1,153 @@ +/** + * Licensed to the Apache Software Foundation

[jira] [Commented] (APEXCORE-415) Input Operator Can Double Checkpoint if Operator CheckpointWindowCount is greater than DAG CheckpointWindowCount

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227180#comment-15227180 ] ASF GitHub Bot commented on APEXCORE-415: - Github user asfgit closed the pull re

[GitHub] incubator-apex-core pull request: APEXCORE-415 #resolve #comment F...

2016-04-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/292 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-apex-core pull request: APEXCORE-10 #resolve Changes for...

2016-04-05 Thread tweise
Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-core/pull/250#issuecomment-205987658 Looking at it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (APEXCORE-10) Enable non-affinity of operators per node (not containers)

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227146#comment-15227146 ] ASF GitHub Bot commented on APEXCORE-10: Github user tweise commented on the pull

[jira] [Updated] (APEXCORE-411) Restart app without specifying app package

2016-04-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXCORE-411: --- Fix Version/s: 3.4.0 > Restart app without specifying app package >

[jira] [Commented] (APEXMALHAR-2026) Spooled Datastructures

2016-04-05 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227119#comment-15227119 ] Timothy Farkas commented on APEXMALHAR-2026: After speaking with Chandni

Launching app directly

2016-04-05 Thread Pramod Immaneni
Hi, I have had questions on how to launch an application using an API. I have setup a project with test code on how to do this with what is available in Apex today. Take a look at it here. https://github.com/PramodSSImmaneni/apex-cluster-launch For having support directly in Apex to do this a JI

Re: [APEXCORE-107] Adding modules in DAG through property and json file.

2016-04-05 Thread Tushar Gosavi
Hi Thomas, I agree with you that module is a composite operator except its not present at the execution time. Actually I feel that there should be another Interface `Node` which specifies a node in the DAG, from which Operator and Module interfaces are extended. This way we may support transformat

Re: Java stream api

2016-04-05 Thread Tushar Gosavi
On Tue, Apr 5, 2016 at 12:14 PM, Siyuan Hua wrote: > I have collected some open topics/questions for discussion already from > folks who already reviewed the code > > 1.The name, name of the Stream and the StreamSource > > 2. Build dag in an incremental way vs lazy population. Incremental way is

[jira] [Commented] (APEXMALHAR-2026) Spooled Datastructures

2016-04-05 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226962#comment-15226962 ] Timothy Farkas commented on APEXMALHAR-2026: An outline of how this would

[GitHub] incubator-apex-core pull request: APEXCORE-411 support restarting ...

2016-04-05 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/294#discussion_r58595340 --- Diff: engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java --- @@ -210,14 +239,67 @@ public StramAppLauncher(FileSystem

[jira] [Commented] (APEXCORE-411) Restart app without specifying app package

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226920#comment-15226920 ] ASF GitHub Bot commented on APEXCORE-411: - Github user davidyan74 commented on a

[jira] [Commented] (APEXCORE-10) Enable non-affinity of operators per node (not containers)

2016-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226885#comment-15226885 ] ASF GitHub Bot commented on APEXCORE-10: Github user ishark commented on the pull

[GitHub] incubator-apex-core pull request: APEXCORE-10 #resolve Changes for...

2016-04-05 Thread ishark
Github user ishark commented on the pull request: https://github.com/apache/incubator-apex-core/pull/250#issuecomment-205941259 Have addressed most of the review comments except convenience APIs in DAG. Did quick sanity testing on Cloudera after changes. @tweise Could you please r

[jira] [Commented] (APEXMALHAR-2026) Spooled Datastructures

2016-04-05 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226798#comment-15226798 ] Thomas Weise commented on APEXMALHAR-2026: -- That's right. Probably good to o

[jira] [Commented] (APEXMALHAR-2026) Spooled Datastructures

2016-04-05 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226730#comment-15226730 ] Timothy Farkas commented on APEXMALHAR-2026: Also we don't have to worry

[jira] [Commented] (APEXMALHAR-2026) Spooled Datastructures

2016-04-05 Thread Timothy Farkas (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226725#comment-15226725 ] Timothy Farkas commented on APEXMALHAR-2026: The user could specify a ser

[jira] [Commented] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-04-05 Thread Priyanka Gugale (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226158#comment-15226158 ] Priyanka Gugale commented on APEXMALHAR-2045: - high level design we are c

[jira] [Created] (APEXMALHAR-2045) Add bandwidth control feature to Apex

2016-04-05 Thread Priyanka Gugale (JIRA)
Priyanka Gugale created APEXMALHAR-2045: --- Summary: Add bandwidth control feature to Apex Key: APEXMALHAR-2045 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2045 Project: Apache Apex Malha

Re: proposal for reconciled JDBC output operator

2016-04-05 Thread Yogi Devendra
This would great value addition for other operators. +1 for making this operator plugin. ~ Yogi On 4 April 2016 at 12:40, Shubham Pathak wrote: > +1 for having this as a platform feature. > > On Mon, Apr 4, 2016 at 12:27 PM, Bhupesh Chawda > wrote: > > > +1 on making this an Apex feature. It w