Re: Contribute to Release Management

2016-03-08 Thread Pradeep Kumbhar
Hi Jayaradha, First of all, Welcome to the Apex-Dev community! Happy to see that you want to contribute to testing down the line. I'll talk about the "*testing part*" and others in the community can comment on the process for release management/automation. To start with you can have a look at ht

[jira] [Updated] (APEXCORE-375) Container killed because of Out of Sequence tuple error.

2016-03-08 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXCORE-375: -- Fix Version/s: 3.3.1 3.4.0 3.2.1 > Container killed beca

[jira] [Resolved] (APEXCORE-375) Container killed because of Out of Sequence tuple error.

2016-03-08 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXCORE-375. --- Resolution: Fixed > Container killed because of Out of Sequence tuple error. > -

[jira] [Resolved] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXCORE-374. --- Resolution: Fixed > Block with positive reference count is found during buffer server purge

[jira] [Closed] (APEXCORE-354) Add forum link for mailing lists

2016-03-08 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise closed APEXCORE-354. - Resolution: Fixed > Add forum link for mailing lists > -- > >

[jira] [Updated] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXCORE-374: -- Fix Version/s: 3.3.1 3.4.0 3.2.1 > Block with positive r

[GitHub] incubator-apex-site pull request: APEXCORE-354 Added link for nabb...

2016-03-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-site/pull/14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[jira] [Commented] (APEXCORE-354) Add forum link for mailing lists

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186120#comment-15186120 ] ASF GitHub Bot commented on APEXCORE-354: - Github user asfgit closed the pull re

[jira] [Commented] (APEXCORE-354) Add forum link for mailing lists

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185998#comment-15185998 ] ASF GitHub Bot commented on APEXCORE-354: - Github user tweise commented on the p

[GitHub] incubator-apex-site pull request: APEXCORE-354 Added link for nabb...

2016-03-08 Thread tweise
Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-site/pull/14#issuecomment-194002185 @sashadt please refer to the comments above, @chinmaykolhatkar had sent a test email. --- If your project is set up for it, you can reply to this email and h

[GitHub] incubator-apex-site pull request: APEXCORE-354 Added link for nabb...

2016-03-08 Thread sashadt
Github user sashadt commented on the pull request: https://github.com/apache/incubator-apex-site/pull/14#issuecomment-194001421 @chinmaykolhatkar What makes something a forum is ability to discuss the topic. However, if this discussion never makes it back to dev@ or user@ mailing lis

[jira] [Commented] (APEXCORE-354) Add forum link for mailing lists

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185989#comment-15185989 ] ASF GitHub Bot commented on APEXCORE-354: - Github user sashadt commented on the

Contribute to Release Management

2016-03-08 Thread Jayaradha Natarajan
I am Jayaradha. I would like to contribute to Apache Apex release management, release automation and testing to start with. Eventually I will start contributing to development. Please let me know the steps to contribute to Release management and testing. Thanks, Jayaradha

Re: Failure while writing flushing HDHT

2016-03-08 Thread Ganelin, Ilya
The only other failure we see appears to be a subsequent failure: Caused by: java.io.FileNotFoundException: File does not exist: /PATH_OMITTED/hdht/62/62/62/0/0-0 at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:66) at org.apache.hadoop.hdfs.server.name

Re: Failure while writing flushing HDHT

2016-03-08 Thread Thomas Weise
Is there no nested exception? On Tue, Mar 8, 2016 at 11:25 AM, Ganelin, Ilya wrote: > Hi all – we are seeing the following error when running our DAG. Would > really appreciate any insight as to why this is happening. Is HDFS full? Is > this a serialization failure? Any way to track down what

Re: Failure while writing flushing HDHT

2016-03-08 Thread Pramod Immaneni
Ilya, Are there any other exceptions from HDFS that you see in the logs around this exception? Thanks On Tue, Mar 8, 2016 at 11:25 AM, Ganelin, Ilya wrote: > Hi all – we are seeing the following error when running our DAG. Would > really appreciate any insight as to why this is happening. Is H

Failure while writing flushing HDHT

2016-03-08 Thread Ganelin, Ilya
Hi all – we are seeing the following error when running our DAG. Would really appreciate any insight as to why this is happening. Is HDFS full? Is this a serialization failure? Any way to track down what is going on? Stopped running due to an exception. java.lang.RuntimeException: Error while

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/265 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185487#comment-15185487 ] ASF GitHub Bot commented on APEXCORE-374: - Github user asfgit closed the pull re

Re: Naming: STRAM and StreamingContainer

2016-03-08 Thread David Yan
I think this name change will only happen when we have our next major release. At that point, we won't have com.datatorrent anywhere in Apex code. Everything will be changed to org.apache.apex. David On Tue, Mar 8, 2016 at 10:40 AM, Vlad Rozov wrote: > Will the change affect "com.datatorrent.

Re: Naming: STRAM and StreamingContainer

2016-03-08 Thread Vlad Rozov
Will the change affect "com.datatorrent.stram" package name and few dozen classes that start with "Stram"? If not, other than documentation what will be affected by the rename? Will the rename lead to any backward compatibility problems? Thank you, Vlad On 3/7/16 14:14, Thomas Weise wrote:

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185417#comment-15185417 ] ASF GitHub Bot commented on APEXCORE-374: - Github user vrozov commented on the p

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185416#comment-15185416 ] ASF GitHub Bot commented on APEXCORE-374: - Github user vrozov commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread vrozov
Github user vrozov commented on the pull request: https://github.com/apache/incubator-apex-core/pull/265#issuecomment-193900899 @tweise Please merge after Travis build is done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/265#discussion_r55402374 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/LogicalNode.java --- @@ -346,7 +346,9 @@ public void boot(EventLoop ev

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185393#comment-15185393 ] ASF GitHub Bot commented on APEXCORE-374: - Github user PramodSSImmaneni commente

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread PramodSSImmaneni
Github user PramodSSImmaneni commented on the pull request: https://github.com/apache/incubator-apex-core/pull/265#issuecomment-193896030 Looks good from my side as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185372#comment-15185372 ] ASF GitHub Bot commented on APEXCORE-374: - Github user tweise commented on the p

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread tweise
Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-core/pull/265#issuecomment-193893016 @vrozov rest looks good. Let me know when it is ready for merge. --- If your project is set up for it, you can reply to this email and have your reply appea

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185275#comment-15185275 ] ASF GitHub Bot commented on APEXCORE-374: - Github user tweise commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/265#discussion_r55391551 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/LogicalNode.java --- @@ -346,7 +346,9 @@ public void boot(EventLoop ev

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185263#comment-15185263 ] ASF GitHub Bot commented on APEXCORE-374: - Github user vrozov commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/265#discussion_r55391080 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/LogicalNode.java --- @@ -346,7 +346,9 @@ public void boot(EventLoop ev

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/265#discussion_r55378575 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/LogicalNode.java --- @@ -93,7 +88,7 @@ public String getGroup()

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185122#comment-15185122 ] ASF GitHub Bot commented on APEXCORE-374: - Github user tweise commented on a dif

[jira] [Commented] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185121#comment-15185121 ] ASF GitHub Bot commented on APEXCORE-374: - Github user tweise commented on a dif

[GitHub] incubator-apex-core pull request: APEXCORE-374 - Block with positi...

2016-03-08 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/265#discussion_r55378492 --- Diff: bufferserver/src/main/java/com/datatorrent/bufferserver/internal/LogicalNode.java --- @@ -346,7 +346,9 @@ public void boot(EventLoop ev

[jira] [Updated] (APEXCORE-374) Block with positive reference count is found during buffer server purge

2016-03-08 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov updated APEXCORE-374: Affects Version/s: 3.3.1 3.4.0 3.2.1

[GitHub] incubator-apex-malhar pull request: Apexmalhar-2008: hdfs file rea...

2016-03-08 Thread DT-Priyanka
Github user DT-Priyanka closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/206 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

Re: Adding Transform Operator to Malhar

2016-03-08 Thread Devendra Tagare
+1 Dev On Tue, Mar 8, 2016 at 5:38 PM, Yogi Devendra wrote: > Forgot to add in earlier email: > > +1 for this operator. > > ~ Yogi > > On 8 March 2016 at 17:03, Yogi Devendra wrote: > > > Can we think of better name than Transform operator? > > May be: > > Expression operator > > > > Reason:

Re: Adding Transform Operator to Malhar

2016-03-08 Thread Yogi Devendra
Forgot to add in earlier email: +1 for this operator. ~ Yogi On 8 March 2016 at 17:03, Yogi Devendra wrote: > Can we think of better name than Transform operator? > May be: > Expression operator > > Reason: > We have many operators which are doing 'transform'. So, this name looks > very generi

Re: Adding Transform Operator to Malhar

2016-03-08 Thread Yogi Devendra
Can we think of better name than Transform operator? May be: Expression operator Reason: We have many operators which are doing 'transform'. So, this name looks very generic. In fact, from the users perspective, I always consider any operator like a black-box doing some transformation. ~ Yogi O

Re: Adding Transform Operator to Malhar

2016-03-08 Thread Mohit Jotwani
This can have as many util functions added to it to perform various transformations to the tuple. +1 Regards, Mohit On 8 Mar 2016 16:42, "Sandeep Deshmukh" wrote: > Looks good to me. > > Regards, > Sandeep > > On Mon, Mar 7, 2016 at 9:51 PM, Chinmay Kolhatkar > wrote: > > > Dear Community, > >

Re: Adding Transform Operator to Malhar

2016-03-08 Thread Sandeep Deshmukh
Looks good to me. Regards, Sandeep On Mon, Mar 7, 2016 at 9:51 PM, Chinmay Kolhatkar wrote: > Dear Community, > > We're creating a transform operator which will allow the apex users to > transform data over a stream using this operator. > > Use Case: > > When the data has been received fro

[jira] [Created] (APEXMALHAR-2012) Avro Record to POJO converter

2016-03-08 Thread devendra tagare (JIRA)
devendra tagare created APEXMALHAR-2012: --- Summary: Avro Record to POJO converter Key: APEXMALHAR-2012 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2012 Project: Apache Apex Malhar

[jira] [Updated] (APEXMALHAR-2011) POJO to Avro record converter

2016-03-08 Thread devendra tagare (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] devendra tagare updated APEXMALHAR-2011: Issue Type: New Feature (was: Bug) > POJO to Avro record converter > -

[jira] [Created] (APEXMALHAR-2011) POJO to Avro record converter

2016-03-08 Thread devendra tagare (JIRA)
devendra tagare created APEXMALHAR-2011: --- Summary: POJO to Avro record converter Key: APEXMALHAR-2011 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2011 Project: Apache Apex Malhar

[GitHub] incubator-apex-malhar pull request: Apexmalhar-2008: hdfs file rea...

2016-03-08 Thread DT-Priyanka
GitHub user DT-Priyanka opened a pull request: https://github.com/apache/incubator-apex-malhar/pull/206 Apexmalhar-2008: hdfs file reader module Code to add HDFS file reader module. 1. The module reads file/list of files (directory is also accepted) and emit the file blocks.

[jira] [Created] (APEXMALHAR-2010) Add transform operator

2016-03-08 Thread Chinmay Kolhatkar (JIRA)
Chinmay Kolhatkar created APEXMALHAR-2010: - Summary: Add transform operator Key: APEXMALHAR-2010 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2010 Project: Apache Apex Malhar