[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268159#comment-15268159 ] ASF GitHub Bot commented on APEXCORE-330: - Github user sandeshh commented on a d

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread sandeshh
Github user sandeshh commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61840735 --- Diff: engine/src/main/java/com/datatorrent/stram/cli/ApexCli.java --- @@ -3366,6 +3370,28 @@ public void execute(String[] args, ConsoleReader

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Pramod Immaneni
I don't think we should rename Module to CompositeOperator as it will break backwards compatibility. If this is something we want to go forward with then we should think about depreacting Module. Thanks On Mon, May 2, 2016 at 10:46 PM, Tushar Gosavi wrote: > +1 > > I have a pull request #313 op

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Akshay Gore
+1 for CompositeOperator "Module" is little confusing for new users who are familiar with operators. I think we should change the field name in JSON to make it constant. -Akshay On Tue, May 3, 2016 at 11:16 AM, Tushar Gosavi wrote: > +1 > > I have a pull request #313 opened for Module related

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Tushar Gosavi
+1 I have a pull request #313 opened for Module related work. I will do following changes to incorporate this suggestion. - Rename Module to CompositeOperator - Rename Vertex in DAG to GenerticOperator Do we also need to change the rest API to reflex the name change? The only change required is

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Amol Kekre
The packaging has been taken up by other names, module is now a java only construct. Thks, Amol On Mon, May 2, 2016 at 8:15 PM, Sandesh Hegde wrote: > Earlier the vision was, module can contain widgets/UI along with the > operators. So it made sense to have that name. > If that is not the case

[jira] [Updated] (APEXCORE-402) SpscArrayQueue to notify publishing thread on not full condition

2016-05-02 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXCORE-402: -- Summary: SpscArrayQueue to notify publishing thread on not full condition (was: Provide SpscA

[jira] [Resolved] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXCORE-402. --- Resolution: Fixed > Provide SpscArrayQueue based implementation that uses Condition to notif

[jira] [Commented] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268089#comment-15268089 ] ASF GitHub Bot commented on APEXCORE-402: - Github user asfgit closed the pull re

[GitHub] incubator-apex-core pull request: APEXCORE-402

2016-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/286 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Sandesh Hegde
Earlier the vision was, module can contain widgets/UI along with the operators. So it made sense to have that name. If that is not the case then +1 for CompositeOperator On Mon, May 2, 2016 at 7:53 PM Amol Kekre wrote: > Good point. +1 > > Thks > Amol > > > On Mon, May 2, 2016 at 6:17 PM, Sasha

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Amol Kekre
Good point. +1 Thks Amol On Mon, May 2, 2016 at 6:17 PM, Sasha Parfenov wrote: > +1. > > Everybody is already familiar with concept of an Operators in Apex. It is > best to keep that terminology, and use CompositeOperator to indicate they > related to Operators, rather than introduce a new co

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267944#comment-15267944 ] Thomas Weise commented on APEXCORE-330: --- Sounds like V2 > Ability to obtain a thr

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267890#comment-15267890 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on t

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on the pull request: https://github.com/apache/incubator-apex-core/pull/321#issuecomment-216412358 @PramodSSImmaneni Any thread that has a stack trace that is running from the StreamingContainer class is the operator main thread, but I don't think we

[jira] [Commented] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267882#comment-15267882 ] Vlad Rozov commented on APEXCORE-402: - The throughput is around 4 mil tuples/s with

[jira] [Commented] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267883#comment-15267883 ] ASF GitHub Bot commented on APEXCORE-402: - Github user tweise commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-402

2016-05-02 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/286#discussion_r61830152 --- Diff: engine/src/main/java/com/datatorrent/stram/engine/AbstractReservoir.java --- @@ -47,7 +49,7 @@ { private static final Logger

Re: PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread Sasha Parfenov
+1. Everybody is already familiar with concept of an Operators in Apex. It is best to keep that terminology, and use CompositeOperator to indicate they related to Operators, rather than introduce a new concept of Modules. This will also have a significant impact on documentation, where word Oper

[jira] [Updated] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov updated APEXCORE-402: Description: For smaller queue sizes and fast producers/consumers, using condition notification pr

[jira] [Commented] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267843#comment-15267843 ] ASF GitHub Bot commented on APEXCORE-402: - Github user vrozov commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-402

2016-05-02 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/286#discussion_r61828415 --- Diff: engine/src/main/java/com/datatorrent/stram/engine/AbstractReservoir.java --- @@ -47,7 +49,7 @@ { private static final Logger

[jira] [Commented] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267789#comment-15267789 ] ASF GitHub Bot commented on APEXCORE-402: - Github user tweise commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-402

2016-05-02 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/286#discussion_r61825724 --- Diff: engine/src/main/java/com/datatorrent/stram/engine/AbstractReservoir.java --- @@ -47,7 +49,7 @@ { private static final Logger

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267767#comment-15267767 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61824191 --- Diff: engine/src/main/java/com/datatorrent/stram/StramUtils.java --- @@ -81,4 +89,48 @@ } } + public static JSON

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267766#comment-15267766 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61824215 --- Diff: engine/src/main/java/com/datatorrent/stram/StramUtils.java --- @@ -81,4 +89,48 @@ } } + public static JSON

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267760#comment-15267760 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267762#comment-15267762 ] ASF GitHub Bot commented on APEXCORE-330: - Github user PramodSSImmaneni commente

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread PramodSSImmaneni
Github user PramodSSImmaneni commented on the pull request: https://github.com/apache/incubator-apex-core/pull/321#issuecomment-216398640 Can we provide the user a way to distinguish between threads directly related to the operators and user code vs system threads that are apex speci

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61823925 --- Diff: engine/src/main/java/com/datatorrent/stram/cli/ApexCli.java --- @@ -3366,6 +3370,28 @@ public void execute(String[] args, ConsoleRead

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267756#comment-15267756 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61823831 --- Diff: engine/src/main/java/com/datatorrent/stram/StramUtils.java --- @@ -81,4 +89,48 @@ } } + public static JSON

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267758#comment-15267758 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267755#comment-15267755 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267757#comment-15267757 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61823783 --- Diff: engine/src/main/java/com/datatorrent/stram/StramUtils.java --- @@ -81,4 +89,48 @@ } } + public static JSON

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61823801 --- Diff: engine/src/main/java/com/datatorrent/stram/StramUtils.java --- @@ -81,4 +89,48 @@ } } + public static JSON

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61823741 --- Diff: engine/src/main/java/com/datatorrent/stram/StramUtils.java --- @@ -81,4 +89,48 @@ } } + public static JSON

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267753#comment-15267753 ] ASF GitHub Bot commented on APEXCORE-330: - Github user sandeshh commented on the

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread sandeshh
Github user sandeshh commented on the pull request: https://github.com/apache/incubator-apex-core/pull/321#issuecomment-216398153 Addressed all the review comments and squashed the commits. Added the cli support as well. --- If your project is set up for it, you can reply t

[jira] [Commented] (APEXCORE-402) Provide SpscArrayQueue based implementation that uses Condition to notify publishing thread on not full condition

2016-05-02 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267745#comment-15267745 ] Thomas Weise commented on APEXCORE-402: --- [~vrozov] please add a description to thi

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267717#comment-15267717 ] ASF GitHub Bot commented on APEXCORE-107: - Github user PramodSSImmaneni commente

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread PramodSSImmaneni
Github user PramodSSImmaneni commented on the pull request: https://github.com/apache/incubator-apex-core/pull/313#issuecomment-216393279 I also support changing the name to GenericOperator --- If your project is set up for it, you can reply to this email and have your reply appear o

PROPOSAL: Renaming "Module" to "CompositeOperator"

2016-05-02 Thread David Yan
Hi all, >From the javadoc of com.datatorrent.api.Module in Apex Core: A Module is a component which can be added to the DAG similar to the operator, using addModule API. The module should implement populateDAG method, which will be called by the platform, and DAG populated by the module will be r

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267680#comment-15267680 ] ASF GitHub Bot commented on APEXCORE-107: - Github user davidyan74 commented on t

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on the pull request: https://github.com/apache/incubator-apex-core/pull/313#issuecomment-216389226 I think in the field of streaming technology, all of these different nodes in the DAG share the same concept of an operator. So, instead of introducing a

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267389#comment-15267389 ] ASF GitHub Bot commented on APEXCORE-107: - Github user tushargosavi commented on

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267388#comment-15267388 ] ASF GitHub Bot commented on APEXCORE-107: - Github user tushargosavi commented on

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread tushargosavi
Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/313#discussion_r61794711 --- Diff: api/src/main/java/com/datatorrent/api/Component.java --- @@ -116,4 +116,13 @@ public boolean equals(Object obj) }

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread tushargosavi
Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/313#discussion_r61794671 --- Diff: engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlanConfiguration.java --- @@ -2187,6 +2190,27 @@ public void popu

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267341#comment-15267341 ] ASF GitHub Bot commented on APEXCORE-107: - Github user PramodSSImmaneni commente

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread PramodSSImmaneni
Github user PramodSSImmaneni commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/313#discussion_r61790619 --- Diff: api/src/main/java/com/datatorrent/api/Component.java --- @@ -116,4 +116,13 @@ public boolean equals(Object obj) }

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/313#discussion_r61787475 --- Diff: engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlanConfiguration.java --- @@ -2187,6 +2190,27 @@ public void popula

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267300#comment-15267300 ] ASF GitHub Bot commented on APEXCORE-107: - Github user davidyan74 commented on a

[jira] [Created] (APEXCORE-450) Upgrade the version of xml-doclet

2016-05-02 Thread Sandesh (JIRA)
Sandesh created APEXCORE-450: Summary: Upgrade the version of xml-doclet Key: APEXCORE-450 URL: https://issues.apache.org/jira/browse/APEXCORE-450 Project: Apache Apex Core Issue Type: Improvemen

Re: upstream operator id

2016-05-02 Thread Sandesh Hegde
What is the use case? On Mon, May 2, 2016 at 11:30 AM Pramod Immaneni wrote: > Sorry I meant OperatorRequest. > > On Mon, May 2, 2016 at 11:27 AM, Pramod Immaneni > wrote: > > Have you investigated using OperatorCommand? > > > > On Mon, May 2, 2016 at 11:24 AM, Ashwin Chandra Putta > > wrote:

Re: upstream operator id

2016-05-02 Thread Pramod Immaneni
Sorry I meant OperatorRequest. On Mon, May 2, 2016 at 11:27 AM, Pramod Immaneni wrote: > Have you investigated using OperatorCommand? > > On Mon, May 2, 2016 at 11:24 AM, Ashwin Chandra Putta > wrote: >> How can I get the upstream operator id for an input port in a given >> operator? >> >> -- >>

Re: upstream operator id

2016-05-02 Thread Ashwin Chandra Putta
No, so seems like there is no direct api access from the platform right? On Mon, May 2, 2016 at 11:27 AM, Pramod Immaneni wrote: > Have you investigated using OperatorCommand? > > On Mon, May 2, 2016 at 11:24 AM, Ashwin Chandra Putta > wrote: > > How can I get the upstream operator id for an in

Re: upstream operator id

2016-05-02 Thread Pramod Immaneni
Have you investigated using OperatorCommand? On Mon, May 2, 2016 at 11:24 AM, Ashwin Chandra Putta wrote: > How can I get the upstream operator id for an input port in a given > operator? > > -- > > Regards, > Ashwin.

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267208#comment-15267208 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on t

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on the pull request: https://github.com/apache/incubator-apex-core/pull/321#issuecomment-216319603 We will also need cli support. ``` get-container-stacks ``` --- If your project is set up for it, you can reply to this email and have you

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267202#comment-15267202 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61780111 --- Diff: engine/src/main/java/com/datatorrent/stram/engine/StreamingContainer.java --- @@ -690,8 +693,19 @@ public void heartbeatLoop() throw

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267197#comment-15267197 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61779943 --- Diff: engine/src/main/java/com/datatorrent/stram/util/StackTrace.java --- @@ -0,0 +1,77 @@ +/** + * Licensed to the Apache Softwar

upstream operator id

2016-05-02 Thread Ashwin Chandra Putta
How can I get the upstream operator id for an input port in a given operator? -- Regards, Ashwin.

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267192#comment-15267192 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61779550 --- Diff: engine/src/main/java/com/datatorrent/stram/webapp/StramWebServices.java --- @@ -492,6 +494,42 @@ public JSONObject getContainer(@Pa

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267186#comment-15267186 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61779390 --- Diff: engine/src/main/java/com/datatorrent/stram/webapp/StramWebServices.java --- @@ -492,6 +494,42 @@ public JSONObject getContainer(@Pa

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267185#comment-15267185 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61779278 --- Diff: engine/src/main/java/com/datatorrent/stram/webapp/StramWebServices.java --- @@ -492,6 +494,42 @@ public JSONObject getContainer(@Pa

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267182#comment-15267182 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61779139 --- Diff: engine/src/main/java/com/datatorrent/stram/util/StackTrace.java --- @@ -0,0 +1,77 @@ +/** + * Licensed to the Apache Softwar

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61779008 --- Diff: engine/src/main/java/com/datatorrent/stram/util/StackTrace.java --- @@ -0,0 +1,77 @@ +/** + * Licensed to the Apache Softwar

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267178#comment-15267178 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/313#discussion_r61778110 --- Diff: engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlanConfiguration.java --- @@ -2187,6 +2190,27 @@ public void populateDA

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267153#comment-15267153 ] ASF GitHub Bot commented on APEXCORE-107: - Github user tweise commented on a dif

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267147#comment-15267147 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61777915 --- Diff: engine/src/main/java/com/datatorrent/stram/util/StackTrace.java --- @@ -0,0 +1,77 @@ +/** + * Licensed to the Apache Softwar

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r6191 --- Diff: engine/src/main/java/com/datatorrent/stram/util/StackTrace.java --- @@ -0,0 +1,77 @@ +/** + * Licensed to the Apache Softwar

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267143#comment-15267143 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[GitHub] incubator-apex-core pull request: APEXCORE-330 : Stacktrace of the...

2016-05-02 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/321#discussion_r61777550 --- Diff: engine/src/main/java/com/datatorrent/stram/util/StackTrace.java --- @@ -0,0 +1,77 @@ +/** + * Licensed to the Apache Softwar

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267134#comment-15267134 ] ASF GitHub Bot commented on APEXCORE-330: - Github user davidyan74 commented on a

[jira] [Commented] (APEXMALHAR-2072) Cleanup properties of Transform Operator

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266412#comment-15266412 ] ASF GitHub Bot commented on APEXMALHAR-2072: GitHub user chinmaykolhatkar

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2072 Fixing setter ...

2016-05-02 Thread chinmaykolhatkar
GitHub user chinmaykolhatkar opened a pull request: https://github.com/apache/incubator-apex-malhar/pull/264 APEXMALHAR-2072 Fixing setter property variables for better User experience @sandeepdeshmukh @bhupeshchawda Please review and merge. You can merge this pull request into a Gi

[jira] [Created] (APEXMALHAR-2072) Cleanup properties of Transform Operator

2016-05-02 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2072: - Summary: Cleanup properties of Transform Operator Key: APEXMALHAR-2072 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2072 Project: Apache Ape

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266280#comment-15266280 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda co

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-1957: Added threadi...

2016-05-02 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/212#discussion_r61719921 --- Diff: contrib/src/test/java/com/datatorrent/contrib/hbase/HBasePOJOInputOperatorTest.java --- @@ -128,7 +144,7 @@ public void popul

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266278#comment-15266278 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda co

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266277#comment-15266277 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda co

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-1957: Added threadi...

2016-05-02 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/212#discussion_r61719506 --- Diff: contrib/src/main/java/com/datatorrent/contrib/hbase/HBaseScanOperator.java --- @@ -40,27 +51,106 @@ * @tags hbase, scan,

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-1957: Added threadi...

2016-05-02 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/212#discussion_r61719497 --- Diff: contrib/src/main/java/com/datatorrent/contrib/hbase/HBaseScanOperator.java --- @@ -40,27 +51,106 @@ * @tags hbase, scan,

[jira] [Commented] (APEXMALHAR-1957) Improve HBasePOJOInputOperator with support for threaded read

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266276#comment-15266276 ] ASF GitHub Bot commented on APEXMALHAR-1957: Github user bhupeshchawda co

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-1957: Added threadi...

2016-05-02 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/212#discussion_r61719426 --- Diff: contrib/src/main/java/com/datatorrent/contrib/hbase/HBaseScanOperator.java --- @@ -40,27 +51,106 @@ * @tags hbase, scan,

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266263#comment-15266263 ] ASF GitHub Bot commented on APEXCORE-107: - Github user tushargosavi commented on

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread tushargosavi
Github user tushargosavi commented on the pull request: https://github.com/apache/incubator-apex-core/pull/313#issuecomment-216165307 Putting Vertex inside Component , to avoid it being as top level interface. As all node component of the graph inherits from Vertex. --- If your proj

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-02 Thread tushargosavi
Github user tushargosavi commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/313#discussion_r61717221 --- Diff: engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java --- @@ -239,7 +239,7 @@ public void sendMetrics(Collectio

  1   2   >