Re: Malhar release 3.6

2016-10-27 Thread Chinmay Kolhatkar
I request for one more Jira to be included in 3.6.. Its about providing example apps for sql.. Will be creating PR today or tomorrow. On Fri, Oct 28, 2016 at 5:55 AM, Mohit Jotwani wrote: > +1 > > Regards, > Mohit > > On Fri, Oct 28, 2016 at 5:17 AM, Sandesh Hegde > wrote: > > > Here is a one

Blog of a recent meetup event featuring streaming technologies

2016-10-27 Thread Pramod Immaneni
https://www.womeninbigdata.org/2016/10/27/life-does-not-happen-in-batches-introducing-world-of-streaming/

Re: S3 Output Module

2016-10-27 Thread Mohit Jotwani
+1 for Solution 2 Regards, Mohit On 27 Oct 2016 2:02 p.m., "Sandeep Deshmukh" wrote: > +1 > > Regards, > Sandeep > > On Thu, Oct 27, 2016 at 1:53 PM, Chaitanya Chebolu < > chaita...@datatorrent.com> wrote: > > > Hi All, > > > > I am planning to implement the approach (2) of S3 Output Module wh

[jira] [Assigned] (APEXCORE-426) Support work preserving AM recovery

2016-10-27 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh reassigned APEXCORE-426: Assignee: Sandesh > Support work preserving AM recovery > --- > >

Re: Malhar release 3.6

2016-10-27 Thread Mohit Jotwani
+1 Regards, Mohit On Fri, Oct 28, 2016 at 5:17 AM, Sandesh Hegde wrote: > Here is a one more jira for 3.6, I need few more days to open the PR. > https://issues.apache.org/jira/browse/APEXMALHAR-2298?filter=-1 > > Thanks > > > On Thu, Oct 27, 2016 at 10:28 AM Vlad Rozov > wrote: > > +1. It wil

Re: Malhar release 3.6

2016-10-27 Thread Sandesh Hegde
Here is a one more jira for 3.6, I need few more days to open the PR. https://issues.apache.org/jira/browse/APEXMALHAR-2298?filter=-1 Thanks On Thu, Oct 27, 2016 at 10:28 AM Vlad Rozov wrote: +1. It will be nice to have https://issues.apache.org/jira/browse/APEXMALHAR-2178 fixed in 3.6. Thank

[jira] [Created] (APEXCORE-568) whitelist used dependencies

2016-10-27 Thread Vlad Rozov (JIRA)
Vlad Rozov created APEXCORE-568: --- Summary: whitelist used dependencies Key: APEXCORE-568 URL: https://issues.apache.org/jira/browse/APEXCORE-568 Project: Apache Apex Core Issue Type: Improvemen

[jira] [Commented] (APEXMALHAR-2321) Improve Buckets memory management

2016-10-27 Thread bright chen (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613252#comment-15613252 ] bright chen commented on APEXMALHAR-2321: - set Context.OperatorContext.APPLIC

[jira] [Assigned] (APEXMALHAR-2321) Improve Buckets memory management

2016-10-27 Thread bright chen (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright chen reassigned APEXMALHAR-2321: --- Assignee: bright chen > Improve Buckets memory management >

[jira] [Created] (APEXMALHAR-2321) Improve Buckets memory management

2016-10-27 Thread bright chen (JIRA)
bright chen created APEXMALHAR-2321: --- Summary: Improve Buckets memory management Key: APEXMALHAR-2321 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2321 Project: Apache Apex Malhar

Re: example applications in malhar

2016-10-27 Thread Thomas Weise
Maybe a good first step would be to identify which examples to bring over and where appropriate how to structure them in Malhar (for example, I see multiple hdfs related apps that could go into the same Maven module). On Tue, Oct 25, 2016 at 1:00 PM, Thomas Weise wrote: > That would be great. T

[GitHub] apex-site pull request #60: Remove outdated presentation link.

2016-10-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-site/pull/60 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Assigned] (APEXMALHAR-2320) FSWindowDataManager.toSlice() can cause lots of garbage collection

2016-10-27 Thread bright chen (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright chen reassigned APEXMALHAR-2320: --- Assignee: bright chen > FSWindowDataManager.toSlice() can cause lots of garbage

[jira] [Created] (APEXMALHAR-2320) FSWindowDataManager.toSlice() can cause lots of garbage collection

2016-10-27 Thread bright chen (JIRA)
bright chen created APEXMALHAR-2320: --- Summary: FSWindowDataManager.toSlice() can cause lots of garbage collection Key: APEXMALHAR-2320 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2320 Proj

Questions regarding R operator

2016-10-27 Thread ananth
Hello all, I want to use Apex for executing R scripts wherein the parameters for the script are coming in as tuples. In this regard, I have a few questions: * I am presuming that the R dependencies are to be installed on all of the hadoop nodes and the R script is to be put in the classpat

[GitHub] apex-site pull request #60: Remove outdated presentation link.

2016-10-27 Thread tweise
GitHub user tweise opened a pull request: https://github.com/apache/apex-site/pull/60 Remove outdated presentation link. @davidyan74 review You can merge this pull request into a Git repository by running: $ git pull https://github.com/tweise/apex-site master Alternatively you

Re: Malhar release 3.6

2016-10-27 Thread Vlad Rozov
+1. It will be nice to have https://issues.apache.org/jira/browse/APEXMALHAR-2178 fixed in 3.6. Thank you, Vlad On 10/27/16 08:48, Amol Kekre wrote: +1 Thks Amol On Wed, Oct 26, 2016 at 11:22 PM, Milind Barve wrote: +1 On Thu, Oct 27, 2016 at 11:21 AM, Chinmay Kolhatkar wrote: +1.

[jira] [Updated] (APEXMALHAR-2001) Fix all the checkstyle violations in kafka module

2016-10-27 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXMALHAR-2001: - Issue Type: Sub-task (was: Improvement) Parent: APEXMALHAR-1909 > Fix all th

[jira] [Commented] (APEXMALHAR-1909) Fix existing checkstyle violations in Malhar

2016-10-27 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612516#comment-15612516 ] Thomas Weise commented on APEXMALHAR-1909: -- contrib, kafka, benchmark still

[jira] [Updated] (APEXMALHAR-2225) Upgrade checkstyle rules to 1.1.0 and fix trailing whitespace

2016-10-27 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXMALHAR-2225: - Assignee: Thomas Weise > Upgrade checkstyle rules to 1.1.0 and fix trailing whitespac

[jira] [Resolved] (APEXMALHAR-2225) Upgrade checkstyle rules to 1.1.0 and fix trailing whitespace

2016-10-27 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXMALHAR-2225. -- Resolution: Fixed Fix Version/s: 3.6.0 > Upgrade checkstyle rules to 1.1.0 a

[jira] [Resolved] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-27 Thread Yogi Devendra (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yogi Devendra resolved APEXMALHAR-2312. --- Resolution: Fixed Fix Version/s: 3.6.0 > NullPointerException in FileSplit

[jira] [Commented] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612497#comment-15612497 ] ASF GitHub Bot commented on APEXMALHAR-2312: Github user asfgit closed th

[GitHub] apex-malhar pull request #463: APEXMALHAR-2312 Fix NullPointerException for ...

2016-10-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/463 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Malhar release 3.6

2016-10-27 Thread Amol Kekre
+1 Thks Amol On Wed, Oct 26, 2016 at 11:22 PM, Milind Barve wrote: > +1 > > On Thu, Oct 27, 2016 at 11:21 AM, Chinmay Kolhatkar > wrote: > > > +1. > > > > On Thu, Oct 27, 2016 at 1:41 AM, Thomas Weise wrote: > > > > > Hi, > > > > > > I'm proposing another release of Malhar in November. There

[jira] [Commented] (APEXCORE-566) Compute bytes transferred at the logical operator level

2016-10-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611593#comment-15611593 ] ASF GitHub Bot commented on APEXCORE-566: - GitHub user francisf opened a pull re

[GitHub] apex-core pull request #414: APEXCORE-566 Computing bufferServerBytes in the...

2016-10-27 Thread francisf
GitHub user francisf opened a pull request: https://github.com/apache/apex-core/pull/414 APEXCORE-566 Computing bufferServerBytes in the LogicalOperatorInfo @bhupeshchawda Please review. You can merge this pull request into a Git repository by running: $ git pull https://github

[jira] [Created] (APEXMALHAR-2319) Documentation for FSRecordReader Module for line by line reader.

2016-10-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2319: --- Summary: Documentation for FSRecordReader Module for line by line reader. Key: APEXMALHAR-2319 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2319

[jira] [Closed] (APEXCORE-567) Documentation for FSRecordReader Module for line by line reader.

2016-10-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede closed APEXCORE-567. Resolution: Not A Bug > Documentation for FSRecordReader Module for line by line reader. >

[jira] [Created] (APEXCORE-567) Documentation for FSRecordReader Module for line by line reader.

2016-10-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXCORE-567: Summary: Documentation for FSRecordReader Module for line by line reader. Key: APEXCORE-567 URL: https://issues.apache.org/jira/browse/APEXCORE-567 Project: A

[jira] [Created] (APEXCORE-566) Compute bytes transferred at the logical operator level

2016-10-27 Thread Francis Fernandes (JIRA)
Francis Fernandes created APEXCORE-566: -- Summary: Compute bytes transferred at the logical operator level Key: APEXCORE-566 URL: https://issues.apache.org/jira/browse/APEXCORE-566 Project: Apache

[jira] [Commented] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611295#comment-15611295 ] Deepak Narkhede commented on APEXMALHAR-2312: - Changed to Critical becaus

[jira] [Updated] (APEXMALHAR-2312) NullPointerException in FileSplitterInput only if the file path is specified for attribute instead of directory path

2016-10-27 Thread Deepak Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2312: Priority: Critical (was: Minor) > NullPointerException in FileSplitterInput on

[jira] [Created] (APEXMALHAR-2318) Directory scanner threads unable to throw exceptions to parent in FileSplitter

2016-10-27 Thread Deepak Narkhede (JIRA)
Deepak Narkhede created APEXMALHAR-2318: --- Summary: Directory scanner threads unable to throw exceptions to parent in FileSplitter Key: APEXMALHAR-2318 URL: https://issues.apache.org/jira/browse/APEXMALHAR-23

Re: S3 Output Module

2016-10-27 Thread Sandeep Deshmukh
+1 Regards, Sandeep On Thu, Oct 27, 2016 at 1:53 PM, Chaitanya Chebolu < chaita...@datatorrent.com> wrote: > Hi All, > > I am planning to implement the approach (2) of S3 Output Module which I > proposed in my previous email. Performance would be better as compared to > approach (1) because of

Re: S3 Output Module

2016-10-27 Thread Chaitanya Chebolu
Hi All, I am planning to implement the approach (2) of S3 Output Module which I proposed in my previous email. Performance would be better as compared to approach (1) because of uploading the blocks without saving it on HDFS. Please share your opinions. Regards, Chaitanya On Thu, Oct 20, 20