[jira] [Commented] (APEXMALHAR-2276) ManagedState: value of a key does not get over-written in the same time bucket

2016-10-05 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550997#comment-15550997 ] Chaitanya commented on APEXMALHAR-2276: --- I too agree But, I have a query relat

Re: Outer Join

2016-10-05 Thread Thomas Weise
I would recommend you have a look at that PR and participate in the review as many of the challenges discussed apply to the work that you are looking to take up. For example, the state management based on event time is directly applicable to the same stateful transformation that happens in a batch

Outer Join

2016-10-05 Thread Chaitanya Chebolu
Hi David, I am working on Outer Join Using Managed State. This will support event time as well as tuple process time. This covers Left Outer, Right Outer, Full Outer Join. I am planning to start design discussion on dev@apex. But, I have seen a PR(#414

[jira] [Commented] (APEXMALHAR-2276) ManagedState: value of a key does not get over-written in the same time bucket

2016-10-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550649#comment-15550649 ] Chandni Singh commented on APEXMALHAR-2276: --- I agree with [~thw] too. This

[jira] [Commented] (APEXCORE-536) Upgrade Hadoop dependency

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550487#comment-15550487 ] ASF GitHub Bot commented on APEXCORE-536: - GitHub user davidyan74 reopened a pul

[GitHub] apex-core pull request #404: APEXCORE-536 #resolve Upgrade Hadoop dependency...

2016-10-05 Thread davidyan74
Github user davidyan74 closed the pull request at: https://github.com/apache/apex-core/pull/404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXCORE-536) Upgrade Hadoop dependency

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550486#comment-15550486 ] ASF GitHub Bot commented on APEXCORE-536: - Github user davidyan74 closed the pul

[GitHub] apex-core pull request #404: APEXCORE-536 #resolve Upgrade Hadoop dependency...

2016-10-05 Thread davidyan74
GitHub user davidyan74 reopened a pull request: https://github.com/apache/apex-core/pull/404 APEXCORE-536 #resolve Upgrade Hadoop dependency version from 2.2.0 to 2.6.0 You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidyan74/a

[jira] [Commented] (APEXMALHAR-2276) ManagedState: value of a key does not get over-written in the same time bucket

2016-10-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550470#comment-15550470 ] David Yan commented on APEXMALHAR-2276: --- Agreed with [~thw] here. The windowed

[jira] [Created] (APEXCORE-551) Shutdown the application with failed status

2016-10-05 Thread Sandesh (JIRA)
Sandesh created APEXCORE-551: Summary: Shutdown the application with failed status Key: APEXCORE-551 URL: https://issues.apache.org/jira/browse/APEXCORE-551 Project: Apache Apex Core Issue Type:

[jira] [Commented] (APEXCORE-549) Check for problematic hadoop jars at launch time

2016-10-05 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550339#comment-15550339 ] Sandesh commented on APEXCORE-549: -- Default behaviour could be to fail the launch and a

[jira] [Commented] (APEXMALHAR-2276) ManagedState: value of a key does not get over-written in the same time bucket

2016-10-05 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550331#comment-15550331 ] Thomas Weise commented on APEXMALHAR-2276: -- Why does this need to be solved

[jira] [Commented] (APEXCORE-549) Check for problematic hadoop jars at launch time

2016-10-05 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550322#comment-15550322 ] Thomas Weise commented on APEXCORE-549: --- Making the assumption that it conflicts m

[jira] [Commented] (APEXMALHAR-2276) ManagedState: value of a key does not get over-written in the same time bucket

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550316#comment-15550316 ] ASF GitHub Bot commented on APEXMALHAR-2276: GitHub user chandnisingh ope

[GitHub] apex-malhar pull request #443: APEXMALHAR-2276 over writing the value of key...

2016-10-05 Thread chandnisingh
GitHub user chandnisingh opened a pull request: https://github.com/apache/apex-malhar/pull/443 APEXMALHAR-2276 over writing the value of key only when the time is g… …reater than equal to latest time of the entry You can merge this pull request into a Git repository by running:

[jira] [Updated] (APEXCORE-546) Web site: Add use case section to powered by page

2016-10-05 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXCORE-546: -- Component/s: Website > Web site: Add use case section to powered by page > ---

[jira] [Resolved] (APEXMALHAR-2280) Add InterfaceStability annotations to all windowed operator related packages

2016-10-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXMALHAR-2280. --- Resolution: Fixed Assignee: David Yan Fix Version/s: 3.6.0 > Add Interfac

[jira] [Commented] (APEXMALHAR-2280) Add InterfaceStability annotations to all windowed operator related packages

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550225#comment-15550225 ] ASF GitHub Bot commented on APEXMALHAR-2280: Github user asfgit closed th

[GitHub] apex-malhar pull request #442: APEXMALHAR-2280 #resolve added package-info.j...

2016-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/442 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Test coverage tool

2016-10-05 Thread Sanjay Pujare
I like the idea but would like to know the criteria for flagging a pull request. Will you compare overall test coverage percentage or per class coverage percentage? On Thu, Oct 6, 2016 at 3:52 AM, Chandni Singh wrote: > Hi, > > Tim and I spoke sometime back that it will be helpful if we can have

[jira] [Commented] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550141#comment-15550141 ] Pramod Immaneni commented on APEXCORE-548: -- I was thinking about that approach

Test coverage tool

2016-10-05 Thread Chandni Singh
Hi, Tim and I spoke sometime back that it will be helpful if we can have a test coverage tool which flags a pull request if it reduces the test coverage percentage than the previous build. Recently while making improvements to ManagedState (APEXMALHAR-2223

[jira] [Commented] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550100#comment-15550100 ] David Yan commented on APEXCORE-548: I actually think we should make that logic part

[jira] [Commented] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550065#comment-15550065 ] Pramod Immaneni commented on APEXCORE-548: -- Looks like getAppAlias looks at bot

[jira] [Commented] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550044#comment-15550044 ] David Yan commented on APEXCORE-548: Yes, but it's not that simple. First of all, ge

Better error message for java version mismatch

2016-10-05 Thread Sandesh Hegde
Hi All, When an app package is compiled with Java 1.8 and Apex is using 1.7, we see the following behaviour with Apex CLI 1. launch "No applications in Application Package", ideally it should point out the exact error message 2. get-app-package-operators Throws the following exception java.lan

[jira] [Assigned] (APEXCORE-550) User friendly error message when Java version mismatch happens

2016-10-05 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh reassigned APEXCORE-550: Assignee: Sandesh > User friendly error message when Java version mismatch happens >

[jira] [Created] (APEXCORE-550) User friendly error message when Java version mismatch happens

2016-10-05 Thread Sandesh (JIRA)
Sandesh created APEXCORE-550: Summary: User friendly error message when Java version mismatch happens Key: APEXCORE-550 URL: https://issues.apache.org/jira/browse/APEXCORE-550 Project: Apache Apex Core

[jira] [Commented] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550024#comment-15550024 ] Pramod Immaneni commented on APEXCORE-548: -- Wouldn't getDisplayName return the

[jira] [Commented] (APEXMALHAR-2280) Add InterfaceStability annotations to all windowed operator related packages

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550019#comment-15550019 ] ASF GitHub Bot commented on APEXMALHAR-2280: GitHub user davidyan74 opene

[GitHub] apex-malhar pull request #442: APEXMALHAR-2280 #resolve added package-info.j...

2016-10-05 Thread davidyan74
GitHub user davidyan74 opened a pull request: https://github.com/apache/apex-malhar/pull/442 APEXMALHAR-2280 #resolve added package-info.java to denote interface … …stability for all classes that belong to event window processing @siyuanh please merge You can merge this

[jira] [Commented] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550007#comment-15550007 ] David Yan commented on APEXCORE-548: The problem is that ApexCli is using the AppFac

[jira] [Created] (APEXMALHAR-2280) Add InterfaceStability annotations to all windowed operator related packages

2016-10-05 Thread David Yan (JIRA)
David Yan created APEXMALHAR-2280: - Summary: Add InterfaceStability annotations to all windowed operator related packages Key: APEXMALHAR-2280 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2280

[GitHub] apex-core pull request #408: Documentation for CLI support for web service a...

2016-10-05 Thread PramodSSImmaneni
GitHub user PramodSSImmaneni opened a pull request: https://github.com/apache/apex-core/pull/408 Documentation for CLI support for web service authentication mechanisms Documentation for Kerberos SPNEGO, BASIC and DIGEST mechanisms. @vrozov please see You can merge this pul

[jira] [Created] (APEXCORE-549) Check for problematic hadoop jars at launch time

2016-10-05 Thread Munagala V. Ramanath (JIRA)
Munagala V. Ramanath created APEXCORE-549: - Summary: Check for problematic hadoop jars at launch time Key: APEXCORE-549 URL: https://issues.apache.org/jira/browse/APEXCORE-549 Project: Apache A

[jira] [Updated] (APEXCORE-514) Apache Apex website update

2016-10-05 Thread Michelle Xiao (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michelle Xiao updated APEXCORE-514: --- Description: Update Apache Apex website: 1. Nav bar: add "Powered By Apex" and "Roadmap" bet

[jira] [Updated] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXCORE-548: --- Description: ApexCli is incorrectly using the fully qualified class name of the Application class in

[jira] [Created] (APEXCORE-548) ApexCLI does not correctly detect running applications with the same name at launch time

2016-10-05 Thread David Yan (JIRA)
David Yan created APEXCORE-548: -- Summary: ApexCLI does not correctly detect running applications with the same name at launch time Key: APEXCORE-548 URL: https://issues.apache.org/jira/browse/APEXCORE-548

[jira] [Commented] (APEXCORE-514) Apache Apex website update

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549755#comment-15549755 ] ASF GitHub Bot commented on APEXCORE-514: - GitHub user mx4web opened a pull requ

[GitHub] apex-site pull request #52: APEXCORE-514 Improve Apex Website navigations

2016-10-05 Thread mx4web
GitHub user mx4web opened a pull request: https://github.com/apache/apex-site/pull/52 APEXCORE-514 Improve Apex Website navigations @tweise @PramodSSImmaneni @sashadt Please take some time to review my Apex site navigation changes. Thanks! --Michelle You can merge this pull

Re: [VOTE] Hadoop upgrade

2016-10-05 Thread Dongming Liang
+1 for 2.6.x Best Regards, - Dongming Dongming Liang dongming.li...@gmail.com On Oct 5, 2016 11:17 AM, "Sanjay Pujare" wrote: > +1 for 2.6 > > > On Wed, Oct 5, 2016 at 11:52 AM, Pradeep Kumbhar > wrote: > > > +1 for 2.6 > > > > On Tue, Oct 4, 2016 at 8:42 PM, Munagala Ramanath >

Re: APEXMALHAR-1818 : Apex-Calcite Integration

2016-10-05 Thread Thomas Weise
This is great news. Given the size of this PR, we should probably allow for more time for review and feedback. On Wed, Oct 5, 2016 at 4:56 AM, Chinmay Kolhatkar wrote: > Dear Community, > > ​​ > On the review only PR (https://github.com/apache/apex-malhar/pull/432) > that > I created for first

Re: [VOTE] Hadoop upgrade

2016-10-05 Thread Sanjay Pujare
+1 for 2.6 On Wed, Oct 5, 2016 at 11:52 AM, Pradeep Kumbhar wrote: > +1 for 2.6 > > On Tue, Oct 4, 2016 at 8:42 PM, Munagala Ramanath > wrote: > > > +1 for 2.6.x > > > > Ram > > > > On Mon, Oct 3, 2016 at 1:47 PM, David Yan wrote: > > > > > Hi all, > > > > > > Thomas created this ticket for u

[jira] [Updated] (APEXMALHAR-1759) Removing unused property in EchoServer demo

2016-10-05 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh updated APEXMALHAR-1759: Assignee: (was: Amol) > Removing unused property in EchoServer demo > -

[jira] [Commented] (APEXMALHAR-2234) Add user documentation for FilterOperator

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549159#comment-15549159 ] ASF GitHub Bot commented on APEXMALHAR-2234: Github user yogidevendra clo

[jira] [Commented] (APEXMALHAR-2234) Add user documentation for FilterOperator

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549161#comment-15549161 ] ASF GitHub Bot commented on APEXMALHAR-2234: GitHub user yogidevendra reo

[GitHub] apex-malhar pull request #409: APEXMALHAR-2234 FilterOperator documentation

2016-10-05 Thread yogidevendra
Github user yogidevendra closed the pull request at: https://github.com/apache/apex-malhar/pull/409 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[GitHub] apex-malhar pull request #409: APEXMALHAR-2234 FilterOperator documentation

2016-10-05 Thread yogidevendra
GitHub user yogidevendra reopened a pull request: https://github.com/apache/apex-malhar/pull/409 APEXMALHAR-2234 FilterOperator documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/yogidevendra/apex-malhar APEXMALHAR-22

[jira] [Assigned] (APEXCORE-475) change the YARN_APPLICATION_TYPE from DataTorrent to ApacheApex

2016-10-05 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh reassigned APEXCORE-475: Assignee: Sandesh > change the YARN_APPLICATION_TYPE from DataTorrent to ApacheApex > ---

[GitHub] apex-core pull request #407: APEXCORE-476 toString() method was returning wr...

2016-10-05 Thread sandeshh
GitHub user sandeshh opened a pull request: https://github.com/apache/apex-core/pull/407 APEXCORE-476 toString() method was returning wrong window ids, fixing… … this, as the correct information is useful during debugging @vrozov please review. You can merge this pull r

[jira] [Commented] (APEXCORE-476) Window Id calculation in ToString method in SubscribeRequestTuple & GenericRequestTuple is wrong

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549006#comment-15549006 ] ASF GitHub Bot commented on APEXCORE-476: - GitHub user sandeshh opened a pull re

[jira] [Assigned] (APEXCORE-476) Window Id calculation in ToString method in SubscribeRequestTuple & GenericRequestTuple is wrong

2016-10-05 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh reassigned APEXCORE-476: Assignee: Sandesh > Window Id calculation in ToString method in SubscribeRequestTuple & > Generi

[jira] [Commented] (APEXCORE-475) change the YARN_APPLICATION_TYPE from DataTorrent to ApacheApex

2016-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548943#comment-15548943 ] ASF GitHub Bot commented on APEXCORE-475: - GitHub user sandeshh opened a pull re

[GitHub] apex-core pull request #406: APEXCORE-475 Making the application type of ape...

2016-10-05 Thread sandeshh
GitHub user sandeshh opened a pull request: https://github.com/apache/apex-core/pull/406 APEXCORE-475 Making the application type of apex applications as Apac… …heApex and we will still keep DataTorrent as the deprecated tag. @tweise please review. You can merge this pu

Re: APEXMALHAR-1818 : Apex-Calcite Integration

2016-10-05 Thread Chinmay Kolhatkar
Dear Community, ​​ On the review only PR (https://github.com/apache/apex-malhar/pull/432) that I created for first phase of calcite integration, I've received a good feedback for improvement from Julian (from Calcite PMC Chair), Tushar and Yogi. The comments are taken care of all. I think its tim

[jira] [Commented] (APEXMALHAR-1818) Integrate Calcite to support SQL

2016-10-05 Thread Yogi Devendra (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15548137#comment-15548137 ] Yogi Devendra commented on APEXMALHAR-1818: --- Reviewed the PR. Given some co