[jira] [Commented] (APEXCORE-502) Unnecessary byte array copy in DefaultKryoStreamCodec.toByteArray

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423739#comment-15423739 ] ASF GitHub Bot commented on APEXCORE-502: - GitHub user vrozov opened a pull requ

[GitHub] apex-core pull request #370: APEXCORE-502 Unnecessary byte array copy in Def...

2016-08-16 Thread vrozov
GitHub user vrozov opened a pull request: https://github.com/apache/apex-core/pull/370 APEXCORE-502 Unnecessary byte array copy in DefaultKryoStreamCodec.toByteArray @tweise Please review You can merge this pull request into a Git repository by running: $ git pull https://gith

[jira] [Assigned] (APEXCORE-502) Unnecessary byte array copy in DefaultKryoStreamCodec.toByteArray

2016-08-16 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov reassigned APEXCORE-502: --- Assignee: Vlad Rozov > Unnecessary byte array copy in DefaultKryoStreamCodec.toByteArray >

Malhar Newbie / Beginner tasks

2016-08-16 Thread Herger, Brendan
Hey, There is only one Newbie / Beginner task for Malhar. Are there any other tasks that could be labeled Newbie / Beginner? Thanks, Brendan Herger The information contained in this e-mail is confidential and/or proprietary to Capital O

Re: Join Support

2016-08-16 Thread Shunxin Lu
Thanks David. That's very helpful! I will continue to work on that and let you know once I encounter more problems. On Tue, Aug 16, 2016 at 2:02 PM, David Yan wrote: > Hi Shunxin, > > How about declaring the JoinWindowedOperator interface something like this: > > public interface JoinWindowedOpe

Re: Join Support

2016-08-16 Thread David Yan
Hi Shunxin, How about declaring the JoinWindowedOperator interface something like this: public interface JoinWindowedOperator extends WindowedOperator { void accumulateTuple2(Tuple.WindowedTuple tuple); void accumulateTuple3(Tuple.WindowedTuple tuple); void accumulateTuple4(Tuple.Window

[GitHub] apex-malhar pull request #324: Spillable Datastructures PR for review only

2016-08-16 Thread ilooner
Github user ilooner closed the pull request at: https://github.com/apache/apex-malhar/pull/324 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

Re: Join Support

2016-08-16 Thread Shunxin Lu
Hi David, Thanks for the reply. I think I will need to reconsider the whole situation again base on your input. The main problem that I had was, every input port has its own type, how can I write methods that can handle all of them? Thanks, Shunxin On Tue, Aug 16, 2016 at 12:49 PM, David Yan wr

[jira] [Created] (APEXCORE-507) Expose firstWindowMillis (the timestamp when the first window is generated) in the API

2016-08-16 Thread David Yan (JIRA)
David Yan created APEXCORE-507: -- Summary: Expose firstWindowMillis (the timestamp when the first window is generated) in the API Key: APEXCORE-507 URL: https://issues.apache.org/jira/browse/APEXCORE-507

Re: Join Support

2016-08-16 Thread David Yan
Also, regarding the difficulties you mentioned about a new subclass inheriting AbstractWindowedOperator, what specifically are they? David On Tue, Aug 16, 2016 at 12:31 PM, David Yan wrote: > Hi Shunxin, > > One problem with join support using WindowedOperator is that Apex operator > does not s

[jira] [Commented] (APEXCORE-448) Make operator name available in OperatorContext

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423279#comment-15423279 ] ASF GitHub Bot commented on APEXCORE-448: - Github user asfgit closed the pull re

[GitHub] apex-core pull request #368: APEXCORE-448 made operator name available in th...

2016-08-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/368 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

Re: Join Support

2016-08-16 Thread David Yan
Hi Shunxin, One problem with join support using WindowedOperator is that Apex operator does not support variable number of ports so we might have to limit the join operator to, say, 5 input ports. Implementing join support for WindowedOperator should not be difficult, but might be a little messy b

Re: Planning to add an InputOperator for gRPC and Protobuf

2016-08-16 Thread Pramod Immaneni
సెలవు > On Aug 16, 2016, at 9:02 AM, Thomas Weise wrote: > > Sanjay, > > Good proposal. Does gRPC have an asynchronous API or do you need the > separate thread to make blocking calls? > > It may also be interesting to further abstract the RPC interaction to > possibly reuse the base operator for

Re: Planning to add an InputOperator for gRPC and Protobuf

2016-08-16 Thread Thomas Weise
Sanjay, Good proposal. Does gRPC have an asynchronous API or do you need the separate thread to make blocking calls? It may also be interesting to further abstract the RPC interaction to possibly reuse the base operator for similar IO pattern such as HTTP. Thomas On Mon, Aug 15, 2016 at 3:26 P

[jira] [Commented] (APEXMALHAR-2176) expressionFunctions for FilterOperator throws IndexOutOfBounds

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422550#comment-15422550 ] ASF GitHub Bot commented on APEXMALHAR-2176: GitHub user yogidevendra reo

[GitHub] apex-malhar pull request #361: APEXMALHAR-2176 expressionFunctions for Filte...

2016-08-16 Thread yogidevendra
GitHub user yogidevendra reopened a pull request: https://github.com/apache/apex-malhar/pull/361 APEXMALHAR-2176 expressionFunctions for FilterOperator 1. added setExpressionFunctionsItem method You can merge this pull request into a Git repository by running: $ git pull https:

[jira] [Commented] (APEXMALHAR-2176) expressionFunctions for FilterOperator throws IndexOutOfBounds

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422549#comment-15422549 ] ASF GitHub Bot commented on APEXMALHAR-2176: Github user yogidevendra clo

[GitHub] apex-malhar pull request #361: APEXMALHAR-2176 expressionFunctions for Filte...

2016-08-16 Thread yogidevendra
Github user yogidevendra closed the pull request at: https://github.com/apache/apex-malhar/pull/361 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[jira] [Commented] (APEXMALHAR-2196) S3 Record reader module

2016-08-16 Thread Yogi Devendra (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422518#comment-15422518 ] Yogi Devendra commented on APEXMALHAR-2196: --- This module will be similar in

[jira] [Commented] (APEXMALHAR-2176) expressionFunctions for FilterOperator throws IndexOutOfBounds

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422505#comment-15422505 ] ASF GitHub Bot commented on APEXMALHAR-2176: Github user yogidevendra clo

[jira] [Commented] (APEXMALHAR-2176) expressionFunctions for FilterOperator throws IndexOutOfBounds

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422506#comment-15422506 ] ASF GitHub Bot commented on APEXMALHAR-2176: GitHub user yogidevendra reo

[GitHub] apex-malhar pull request #361: APEXMALHAR-2176 expressionFunctions for Filte...

2016-08-16 Thread yogidevendra
GitHub user yogidevendra reopened a pull request: https://github.com/apache/apex-malhar/pull/361 APEXMALHAR-2176 expressionFunctions for FilterOperator 1. added setExpressionFunctionsItem method You can merge this pull request into a Git repository by running: $ git pull https:

[GitHub] apex-malhar pull request #361: APEXMALHAR-2176 expressionFunctions for Filte...

2016-08-16 Thread yogidevendra
Github user yogidevendra closed the pull request at: https://github.com/apache/apex-malhar/pull/361 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[jira] [Created] (APEXMALHAR-2196) S3 Record reader module

2016-08-16 Thread Yogi Devendra (JIRA)
Yogi Devendra created APEXMALHAR-2196: - Summary: S3 Record reader module Key: APEXMALHAR-2196 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2196 Project: Apache Apex Malhar Issue

[jira] [Commented] (APEXMALHAR-2195) LineReaderContext gives incorrect results for files not ending with the newline

2016-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422472#comment-15422472 ] ASF GitHub Bot commented on APEXMALHAR-2195: GitHub user yogidevendra ope

[GitHub] apex-malhar pull request #372: APEXMALHAR-2195 - Fixing LineReaderContext Is...

2016-08-16 Thread yogidevendra
GitHub user yogidevendra opened a pull request: https://github.com/apache/apex-malhar/pull/372 APEXMALHAR-2195 - Fixing LineReaderContext Issue 2. Changes in the test app You can merge this pull request into a Git repository by running: $ git pull https://github.com/yogidevendr

[jira] [Commented] (APEXMALHAR-2195) LineReaderContext gives incorrect results for files not ending with the newline

2016-08-16 Thread Yogi Devendra (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422467#comment-15422467 ] Yogi Devendra commented on APEXMALHAR-2195: --- ReaderContext.LineReaderContex

[jira] [Created] (APEXMALHAR-2195) LineReaderContext gives incorrect results for files not ending with the newline

2016-08-16 Thread Yogi Devendra (JIRA)
Yogi Devendra created APEXMALHAR-2195: - Summary: LineReaderContext gives incorrect results for files not ending with the newline Key: APEXMALHAR-2195 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2195