Re: Proposal to upgrade Apex Core dependency in Malhar to 3.6

2017-05-11 Thread Bhupesh Chawda
+1 ~ Bhupesh ___ Bhupesh Chawda E: bhup...@datatorrent.com | Twitter: @bhupeshsc www.datatorrent.com | apex.apache.org On Fri, May 12, 2017 at 10:32 AM, Priyanka Gugale wrote: > +1 to upgrade dependency version. > > -Priyanka > > On T

Re: Proposal to upgrade Apex Core dependency in Malhar to 3.6

2017-05-11 Thread Priyanka Gugale
+1 to upgrade dependency version. -Priyanka On Thu, May 11, 2017 at 7:22 PM, Thomas Weise wrote: > +1 for upgrade to 3.6 > > https://issues.apache.org/jira/browse/APEXMALHAR-2471 > > > On Thu, May 11, 2017 at 5:51 AM, AJAY GUPTA wrote: > > > Hi all, > > > > Apex Malhar currently depends on cor

[jira] [Created] (APEXCORE-719) Pass an application name from stram client to application master and container via command line properties

2017-05-11 Thread Sergey Golovko (JIRA)
Sergey Golovko created APEXCORE-719: --- Summary: Pass an application name from stram client to application master and container via command line properties Key: APEXCORE-719 URL: https://issues.apache.org/jira/bro

Re: [DISCUSS] Proposal for adapting Malhar operators for batch use cases

2017-05-11 Thread Bhupesh Chawda
I think we should have the support to allow running multiple batches through the same DAG. Resetting the watermark to the initial watermark seems like a good idea. The windowed operator needs to understand the start/end batch control tuple and reset the watermark. ~ Bhupesh ___

[jira] [Assigned] (APEXMALHAR-2471) Upgrade apex-core dependency to 3.6.0

2017-05-11 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov reassigned APEXMALHAR-2471: -- Assignee: Ajay Gupta > Upgrade apex-core dependency to 3.6.0 > ---

[jira] [Commented] (APEXMALHAR-2471) Upgrade apex-core dependency to 3.6.0

2017-05-11 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006477#comment-16006477 ] Thomas Weise commented on APEXMALHAR-2471: -- Since 3.6 is out and we need the

Re: [DISCUSS] Proposal for adapting Malhar operators for batch use cases

2017-05-11 Thread Thomas Weise
Usually batches are processed by different instances of a topology. First of all we should agree that running multiple batches through the same DAG *in sequence* is something that we want to address. If yes, then there is the reset problem you are referring to, and it only occurs when you want to

Re: Proposal to upgrade Apex Core dependency in Malhar to 3.6

2017-05-11 Thread Thomas Weise
+1 for upgrade to 3.6 https://issues.apache.org/jira/browse/APEXMALHAR-2471 On Thu, May 11, 2017 at 5:51 AM, AJAY GUPTA wrote: > Hi all, > > Apex Malhar currently depends on core 3.4. Custom tuple support has been > added to core in 3.6. Hence, malhar dependency needs to be updated. > This is

[jira] [Updated] (APEXMALHAR-2471) Upgrade apex-core dependency to 3.6.0

2017-05-11 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXMALHAR-2471: - Summary: Upgrade apex-core dependency to 3.6.0 (was: Upgrade apex-core dependency to

Proposal to upgrade Apex Core dependency in Malhar to 3.6

2017-05-11 Thread AJAY GUPTA
Hi all, Apex Malhar currently depends on core 3.4. Custom tuple support has been added to core in 3.6. Hence, malhar dependency needs to be updated. This is necessary for changing the malhar operators for batch use cases. Let me know the community view on the same. Thanks, Ajay

[jira] [Commented] (APEXCORE-718) How to Use one Kafka input operator and Feed to multiple operator

2017-05-11 Thread Tushar Gosavi (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006246#comment-16006246 ] Tushar Gosavi commented on APEXCORE-718: Please use us...@apex.apache.org mailin

[jira] [Commented] (APEXCORE-718) How to Use one Kafka input operator and Feed to multiple operator

2017-05-11 Thread ROHIT RAJKUMAR GARG (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006224#comment-16006224 ] ROHIT RAJKUMAR GARG commented on APEXCORE-718: -- dag.addStream("kafkaData"

[jira] [Created] (APEXCORE-718) How to Use one Kafka input operator and Feed to multiple operator

2017-05-11 Thread ROHIT RAJKUMAR GARG (JIRA)
ROHIT RAJKUMAR GARG created APEXCORE-718: Summary: How to Use one Kafka input operator and Feed to multiple operator Key: APEXCORE-718 URL: https://issues.apache.org/jira/browse/APEXCORE-718