[GitHub] apex-core pull request #350: APEXCORE-222 Purging the stale data present in ...

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/350 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380343#comment-15380343 ] ASF GitHub Bot commented on APEXCORE-222: - Github user asfgit closed the pull re

The first cut of high-level API for windowed transform is ready, please review

2016-07-15 Thread Siyuan Hua
The first cut of high-level API for windowed transform is ready, please review. https://github.com/apache/apex-malhar/pull/339 Thanks! Regards, Siyuan

[jira] [Commented] (APEXMALHAR-1701) Deduper : create a deduper backed by Managed State

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380192#comment-15380192 ] ASF GitHub Bot commented on APEXMALHAR-1701: Github user davidyan74 comme

[GitHub] apex-malhar pull request #343: [Review Only] APEXMALHAR-1701: Deduper using ...

2016-07-15 Thread davidyan74
Github user davidyan74 commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/343#discussion_r71046708 --- Diff: library/src/test/java/org/apache/apex/malhar/lib/dedup/WindowedDeduperTest.java --- @@ -0,0 +1,160 @@ +/** + * Licensed to the Apac

[GitHub] apex-site issue #43: Adding Powered by Apex page

2016-07-15 Thread sashadt
Github user sashadt commented on the issue: https://github.com/apache/apex-site/pull/43 @tweise, I have updated per your comments. Please review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[jira] [Commented] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380063#comment-15380063 ] ASF GitHub Bot commented on APEXCORE-482: - Github user vrozov commented on the i

[GitHub] apex-core issue #358: *Review only* [APEXCORE-482]Make the downstream operat...

2016-07-15 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/apex-core/pull/358 What is the reason unifier does not have it's own StreamMeta? IMO, it will be better to introduce separate StreamMeta for unifiers instead of the locality field that is used only for unifiers. --

Re: 404 Error

2016-07-15 Thread Aayushi Acharya
Thanks. On Fri, Jul 15, 2016 12:08 PM, Sasha Parfenov sa...@datatorrent.com wrote: The file is available under https://github.com/apache/apex-core/blob/master/codestyle-config/src/main/resources/apex_checks.xml I will update the contributing page to reflect it. Thanks, Sasha On

Re: 404 Error

2016-07-15 Thread Sasha Parfenov
The file is available under https://github.com/apache/apex-core/blob/master/codestyle-config/src/main/resources/apex_checks.xml I will update the contributing page to reflect it. Thanks, Sasha On Fri, Jul 15, 2016 at 12:04 PM, Ashwin Chandra Putta < ashwinchand...@gmail.com> wrote: > Seems like

Re: 404 Error

2016-07-15 Thread Ashwin Chandra Putta
Seems like the file has been moved. https://github.com/apache/apex-core/commit/1853fbc7c27644ad769b3744565a03cc130f52d2 Regards, Ashwin. On Fri, Jul 15, 2016 at 11:32 AM, Aayushi Acharya wrote: > Hello, > I was going through the contributing page for Apache Apex: > http://apex.apache.org/contri

[jira] [Commented] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379915#comment-15379915 ] ASF GitHub Bot commented on APEXCORE-482: - Github user vrozov commented on the i

[GitHub] apex-core issue #358: *Review only* [APEXCORE-482]Make the downstream operat...

2016-07-15 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/apex-core/pull/358 TODO: provide benchmark numbers for 4, 16, 32 and possibly 64 unifiers comparing existing behavior with behavior after the commit. --- If your project is set up for it, you can reply to this email

404 Error

2016-07-15 Thread Aayushi Acharya
Hello, I was going through the contributing page for Apache Apex: http://apex.apache.org/contributing.html and I found that under the Code Style sub-heading there is this line: The checkstyle configuration that Apache Apex projects use is present here : https://github.com/apache/apex-core/blob/ma

[GitHub] apex-malhar pull request #345: REVIEW ONLY (WindowedOperator): splitting Win...

2016-07-15 Thread davidyan74
GitHub user davidyan74 opened a pull request: https://github.com/apache/apex-malhar/pull/345 REVIEW ONLY (WindowedOperator): splitting WindowedStorage in preparation of incorporating Spillable data structures You can merge this pull request into a Git repository by running: $

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379722#comment-15379722 ] ASF GitHub Bot commented on APEXCORE-222: - Github user sandeshh commented on a d

[GitHub] apex-core pull request #350: APEXCORE-222 Purging the stale data present in ...

2016-07-15 Thread sandeshh
Github user sandeshh commented on a diff in the pull request: https://github.com/apache/apex-core/pull/350#discussion_r71008939 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/DataList.java --- @@ -176,21 +176,20 @@ public void reset() numberOfI

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379679#comment-15379679 ] ASF GitHub Bot commented on APEXCORE-222: - Github user gauravgopi123 commented o

[GitHub] apex-core pull request #350: APEXCORE-222 Purging the stale data present in ...

2016-07-15 Thread gauravgopi123
Github user gauravgopi123 commented on a diff in the pull request: https://github.com/apache/apex-core/pull/350#discussion_r71005395 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/DataList.java --- @@ -176,21 +176,20 @@ public void reset() numb

[jira] [Commented] (APEXMALHAR-2155) Make high-level api support multiple ports

2016-07-15 Thread Siyuan Hua (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379647#comment-15379647 ] Siyuan Hua commented on APEXMALHAR-2155: And watermark > Make high-level api

[jira] [Commented] (APEXCORE-222) Delegate Buffer Server purge to StreamingContainer

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379636#comment-15379636 ] ASF GitHub Bot commented on APEXCORE-222: - Github user vrozov commented on the i

[GitHub] apex-core issue #350: APEXCORE-222 Purging the stale data present in the buf...

2016-07-15 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/apex-core/pull/350 @sandeshh Please rebase against latest master and I'll merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Commented] (APEXCORE-482) Default Unifiers should be ThreadLocal with downstream operators

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379496#comment-15379496 ] ASF GitHub Bot commented on APEXCORE-482: - GitHub user sandeshh opened a pull re

[GitHub] apex-core pull request #358: *Review only* [APEXCORE-482]Make the downstream...

2016-07-15 Thread sandeshh
GitHub user sandeshh opened a pull request: https://github.com/apache/apex-core/pull/358 *Review only* [APEXCORE-482]Make the downstream operator & unifier in the same container as THREA… …D_LOCAL Opening it early, to get the feedback on the approach. Note:

[GitHub] apex-malhar pull request #326: APEXMALHAR-2116 Added FS record reader operat...

2016-07-15 Thread amberarrow
Github user amberarrow commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/326#discussion_r70977817 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/fs/FSRecordReaderModule.java --- @@ -0,0 +1,344 @@ +/** + * Licensed to the Apache

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379410#comment-15379410 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user amberarrow comme

Re: APEXMALHAR-1701 Deduper in Malhar

2016-07-15 Thread Yogi Devendra
+1 for Windowed Operator if we manage to take care of the problem you mentioned for this approach in the earlier email. IMO, "WindowedStorage to suit the dedup use case" would open up ways for any other similar use-cases for Windowed Operators which needs some custom handling. -1 for keeping both

condition in FilterOperator

2016-07-15 Thread Yogi Devendra
Hi, I am working on creating example app for com.datatorrent.lib.filter.FilterOperator For condition property, I gave following value: {$}.getAmount() >= 2 This gives following exception: java.lang.RuntimeException: org.codehaus.commons.compiler.CompileException: Line 1, Column 29: Cannot cas

Re: APEXMALHAR-1701 Deduper in Malhar

2016-07-15 Thread Bhupesh Chawda
Hi, ​Yes Pramod, the state is not shared among the sliding windows. Probably, as David suggested, we can create a more apt implementation for WindowedStorage to suit the dedup use case​. And if we are to create a custom storage implementation, we might also have to provide functionality for asynch

Re: auto-generated emails

2016-07-15 Thread Yogi Devendra
+1 on reducing automated emails for comments on dev list. How about having separate mailing list such as commits@apex which would have full archive of comments? New JIRA, PR can be sent to both dev, commits. ~ Yogi On 13 July 2016 at 10:22, Chinmay Kolhatkar wrote: > Strongly +1 for this. > >

[jira] [Commented] (APEXMALHAR-1701) Deduper : create a deduper backed by Managed State

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379095#comment-15379095 ] ASF GitHub Bot commented on APEXMALHAR-1701: Github user bhupeshchawda co

[jira] [Commented] (APEXMALHAR-1701) Deduper : create a deduper backed by Managed State

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15379097#comment-15379097 ] ASF GitHub Bot commented on APEXMALHAR-1701: Github user bhupeshchawda co

[GitHub] apex-malhar pull request #343: [Review Only] APEXMALHAR-1701: Deduper using ...

2016-07-15 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/343#discussion_r70945247 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/dedup/AbstractWindowedDeduper.java --- @@ -0,0 +1,97 @@ +/** + * Licensed to th

[GitHub] apex-malhar pull request #343: [Review Only] APEXMALHAR-1701: Deduper using ...

2016-07-15 Thread bhupeshchawda
Github user bhupeshchawda commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/343#discussion_r70945182 --- Diff: library/src/test/java/org/apache/apex/malhar/lib/dedup/WindowedDeduperTest.java --- @@ -0,0 +1,160 @@ +/** + * Licensed to the A

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378938#comment-15378938 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user yogidevendra com

[GitHub] apex-malhar pull request #326: APEXMALHAR-2116 Added FS record reader operat...

2016-07-15 Thread yogidevendra
Github user yogidevendra commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/326#discussion_r70930388 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/fs/FSRecordReaderModule.java --- @@ -0,0 +1,344 @@ +/** + * Licensed to the Apac

[GitHub] apex-malhar pull request #326: APEXMALHAR-2116 Added FS record reader operat...

2016-07-15 Thread DT-Priyanka
Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/apex-malhar/pull/326#discussion_r70930124 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/fs/FSRecordReaderModule.java --- @@ -0,0 +1,344 @@ +/** + * Licensed to the Apach

[jira] [Commented] (APEXMALHAR-2116) File Record reader module

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378933#comment-15378933 ] ASF GitHub Bot commented on APEXMALHAR-2116: Github user DT-Priyanka comm