Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread Bhupesh Chawda
Agreed Vlad and David. I am just suggesting there should be a wrapper for the user object. It can be a marker interface and we can call it something else like "CustomControl". The user object will be wrapped in another class "ControlTuple" which traverses the BufferServer and will perhaps be exten

Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread Vlad Rozov
I agree with David. Payload of the control tuple is in the userObject and operators/ports don't need to be exposed to the implementation of the ControlTuple class. With the proposed interface operators developers are free to extend ControlTuple further and I don't think that such capability nee

Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread Bhupesh Chawda
Hi David, Actually, I was thinking of another API class called ControlTuple, different from the actual tuple class in buffer server or stram. This could serve as a way for the Buffer server publisher to understand that it is a control tuple and needs to be wrapped differently. ~ Bhupesh On Dec

Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread David Yan
// DefaultInputPort public void processControl(ControlTuple tuple) { // Default Implementation to avoid need to implement it in all implementations } {code} {code} // DefaultOutputPort public void emitControl(ControlTuple tuple) { } I think we don't need to expose the ControlTup

[jira] [Commented] (APEXCORE-591) SubscribeRequestTuple has wrong buffer size when mask is zero

2016-12-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754880#comment-15754880 ] ASF GitHub Bot commented on APEXCORE-591: - GitHub user vrozov opened a pull requ

[GitHub] apex-core pull request #434: APEXCORE-591 - SubscribeRequestTuple has wrong ...

2016-12-16 Thread vrozov
GitHub user vrozov opened a pull request: https://github.com/apache/apex-core/pull/434 APEXCORE-591 - SubscribeRequestTuple has wrong buffer size when mask is zero @tushargosavi Please review You can merge this pull request into a Git repository by running: $ git pull https://g

Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread Bhupesh Chawda
Yes, control tuples would be delivered in the same window in which they were generated. Only the tuples which are duplicated due to shuffling across multiple stages would be deduplicated and then sent only once. ~ Bhupesh On Dec 16, 2016 20:30, "Thomas Weise" wrote: Hi Bhupesh, I don't see an

[jira] [Created] (APEXCORE-591) SubscribeRequestTuple has wrong buffer size when mask is zero

2016-12-16 Thread Vlad Rozov (JIRA)
Vlad Rozov created APEXCORE-591: --- Summary: SubscribeRequestTuple has wrong buffer size when mask is zero Key: APEXCORE-591 URL: https://issues.apache.org/jira/browse/APEXCORE-591 Project: Apache Apex Co

Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread Thomas Weise
Hi Bhupesh, I don't see anything stateful here as control tuples are delivered at the end of the streaming window in which they were generated? Also, control tuples would need to be broadcast to all partitions, and therefore also joined downstream by the engine? (In addition to the case you descr

[jira] [Commented] (APEXCORE-590) Failed to restart application on MapR

2016-12-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754497#comment-15754497 ] ASF GitHub Bot commented on APEXCORE-590: - GitHub user pradeepdalvi opened a pul

[GitHub] apex-core pull request #433: APEXCORE-590: Failed to restart application on ...

2016-12-16 Thread pradeepdalvi
GitHub user pradeepdalvi opened a pull request: https://github.com/apache/apex-core/pull/433 APEXCORE-590: Failed to restart application on MapR - Corrected FS path from URI format to FS You can merge this pull request into a Git repository by running: $ git pull https://githu

[jira] [Commented] (APEXCORE-590) Failed to restart application on MapR

2016-12-16 Thread Pradeep A. Dalvi (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754469#comment-15754469 ] Pradeep A. Dalvi commented on APEXCORE-590: --- This is happening due to f.getPat

[jira] [Updated] (APEXCORE-590) Failed to restart application on MapR

2016-12-16 Thread Pradeep A. Dalvi (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep A. Dalvi updated APEXCORE-590: -- Description: For restarting application, we try to copy previous app state i.e. checkp

[jira] [Created] (APEXCORE-590) Failed to restart application on MapR

2016-12-16 Thread Pradeep A. Dalvi (JIRA)
Pradeep A. Dalvi created APEXCORE-590: - Summary: Failed to restart application on MapR Key: APEXCORE-590 URL: https://issues.apache.org/jira/browse/APEXCORE-590 Project: Apache Apex Core

Re: [DISCUSS] Custom Control Tuples Design

2016-12-16 Thread Bhupesh Chawda
As I understand from the discussion on the other thread, we want custom control tuples to behave like existing control tuples similar to begin window and end window. However the fact that we are allowing the user to bundle a user object inside the control tuple differentiates it from the existing

[jira] [Commented] (APEXMALHAR-2303) S3 Line By Line Module

2016-12-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754184#comment-15754184 ] ASF GitHub Bot commented on APEXMALHAR-2303: Github user ajaygit158 close

[jira] [Commented] (APEXMALHAR-2303) S3 Line By Line Module

2016-12-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15754185#comment-15754185 ] ASF GitHub Bot commented on APEXMALHAR-2303: GitHub user ajaygit158 reope

[GitHub] apex-malhar pull request #478: APEXMALHAR-2303 Added S3RecordReaderModule fo...

2016-12-16 Thread ajaygit158
Github user ajaygit158 closed the pull request at: https://github.com/apache/apex-malhar/pull/478 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] apex-malhar pull request #478: APEXMALHAR-2303 Added S3RecordReaderModule fo...

2016-12-16 Thread ajaygit158
GitHub user ajaygit158 reopened a pull request: https://github.com/apache/apex-malhar/pull/478 APEXMALHAR-2303 Added S3RecordReaderModule for reading records line by line @chaithu14 @yogidevendra Kindly review You can merge this pull request into a Git repository by running: $

Re: Shell script for launching and shutting down

2016-12-16 Thread Aniruddha Thombare
Note: You can pipe STDIN to apex CLI too. Thanks, A _ Sent with difficulty, I mean handheld ;) On 16 Dec 2016 12:02 pm, "AJAY GUPTA" wrote: > Hi > > You can use the -e option to specify commands to be executed on apex cli > For example : > apex -e "list-a