[jira] [Commented] (APEXCORE-442) Remove "incubation" and its variants from our code base

2016-05-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271939#comment-15271939 ] Thomas Weise commented on APEXCORE-442: --- Waiting for infra for repository name cha

Re: Apex 3.4.0 release

2016-05-04 Thread Thomas Weise
Since there aren't any open issues remaining for 3.4.0, I'm going to cut the RC tomorrow. On Thu, Apr 28, 2016 at 10:22 PM, Chinmay Kolhatkar wrote: > Hi Thomas, > > Can we have APEXCORE-304 in RC? > > I've taken care of all the comments in PR: > https://github.com/apache/incubator-apex-core/p

[jira] [Updated] (APEXCORE-442) Remove "incubation" and its variants from our code base

2016-05-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXCORE-442: -- Fix Version/s: (was: 3.4.0) > Remove "incubation" and its variants from our code base > --

[jira] [Resolved] (APEXCORE-107) Support adding module to application using property file API.

2016-05-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXCORE-107. --- Resolution: Fixed Fix Version/s: 3.4.0 > Support adding module to application using p

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271931#comment-15271931 ] ASF GitHub Bot commented on APEXCORE-107: - Github user asfgit closed the pull re

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Updated] (APEXMALHAR-2081) Remove FSFileSplitter

2016-05-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXMALHAR-2081: - Fix Version/s: 3.4.0 > Remove FSFileSplitter > - > >

Re: NFS Input Module

2016-05-04 Thread Chandni Singh
I am sorry Chaitanya but I have more questions about this 1. why is the FS Input Module abstract when by default it can return FileSplitter & BlockReader in com.datatorrent.lib.io.fs? These implementations are not specific to NFS. 2. In the NFS module that you have suggested to create, what is s

Re: NFS Input Module

2016-05-04 Thread Chaitanya Chebolu
FSFileSplitter & BlockReader are available in com.datatorrent.lib.io.fs package. On Thu, May 5, 2016 at 10:47 AM, Chandni Singh wrote: > Ok. What is specific about the fileSplitter and blockReader returned by > this implementation? > > > On May 4, 2016 9:43 PM, "Chaitanya Chebolu" > wrote: > >

[jira] [Created] (APEXMALHAR-2081) Remove FSFileSplitter

2016-05-04 Thread Chandni Singh (JIRA)
Chandni Singh created APEXMALHAR-2081: - Summary: Remove FSFileSplitter Key: APEXMALHAR-2081 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2081 Project: Apache Apex Malhar Issue Ty

Re: NFS Input Module

2016-05-04 Thread Chandni Singh
Ok. What is specific about the fileSplitter and blockReader returned by this implementation? On May 4, 2016 9:43 PM, "Chaitanya Chebolu" wrote: > Hi Chandni, > > Properties wise nothing specific. FS Input Module is an abstract Module and > NFS Module implements the abstract methods - createFile

Re: NFS Input Module

2016-05-04 Thread Chaitanya Chebolu
Hi Chandni, Properties wise nothing specific. FS Input Module is an abstract Module and NFS Module implements the abstract methods - createFileSplitter() and createBlockReader(). Regards, Chaitanya On Wed, May 4, 2016 at 9:45 PM, Chandni Singh wrote: > Hi Chaitanya, > > What will be specific i

[jira] [Commented] (APEXCORE-427) Unit test testAppDataPush fails on Travis

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271883#comment-15271883 ] ASF GitHub Bot commented on APEXCORE-427: - Github user asfgit closed the pull re

[GitHub] incubator-apex-core pull request: APEXCORE-427 use system property...

2016-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/325 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-apex-site pull request: Adding announcements and meetups...

2016-05-04 Thread tweise
Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-site/pull/36#issuecomment-217044674 We should reduce the amount of entries shown. It's not an announcement page. We may want to have other content on the home page in the future. --- If your pr

[GitHub] incubator-apex-site pull request: Adding announcements and meetups...

2016-05-04 Thread davidyan74
Github user davidyan74 commented on the pull request: https://github.com/apache/incubator-apex-site/pull/36#issuecomment-217038509 I'm +1 with the change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[jira] [Commented] (APEXCORE-386) Upgrade to Jackson 1.9.13

2016-05-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271605#comment-15271605 ] Thomas Weise commented on APEXCORE-386: --- [~cowtowncoder] That should be a small ch

[jira] [Commented] (APEXCORE-386) Upgrade to Jackson 1.9.13

2016-05-04 Thread Sandesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271588#comment-15271588 ] Sandesh commented on APEXCORE-386: -- Apex supports Hadoop 2.2, which has a dependency on

[GitHub] incubator-apex-site pull request: Adding announcements and meetups...

2016-05-04 Thread amberarrow
Github user amberarrow commented on the pull request: https://github.com/apache/incubator-apex-site/pull/36#issuecomment-217027688 I personally think it makes the front page too busy. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[jira] [Commented] (APEXCORE-427) Unit test testAppDataPush fails on Travis

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271572#comment-15271572 ] ASF GitHub Bot commented on APEXCORE-427: - GitHub user davidyan74 opened a pull

[GitHub] incubator-apex-core pull request: APEXCORE-427 use system property...

2016-05-04 Thread davidyan74
GitHub user davidyan74 opened a pull request: https://github.com/apache/incubator-apex-core/pull/325 APEXCORE-427 use system property instead of environment variable. Apparently environment variable don't propagate to the unit test jvm @tweise please review You can merge this pull

Apex announcements and meetups on front page

2016-05-04 Thread Sasha Parfenov
I think it would be helpful to see the list of latest announcements and upcoming meetups on the front page of apex.apache.org. Here is a sample: Please review https://github.com/apache/incubator-apex-site/pull/36 and provide feedback. Thanks, Sasha

[GitHub] incubator-apex-site pull request: Adding announcements and meetups...

2016-05-04 Thread sashadt
GitHub user sashadt opened a pull request: https://github.com/apache/incubator-apex-site/pull/36 Adding announcements and meetups to Apex front page Updated front page: ![image](https://cloud.githubusercontent.com/assets/4966983/15031353/e5c88822-120c-11e6-89ba-b8edfd277c9f

Launching DT Automatically with Jenkins

2016-05-04 Thread Ganelin, Ilya
Hi all – we have a simple Jenkins install (single node, HDFS, YARN) and we’re attempting to automatically install DT, and launch an app. We’re running into several issues however, including errors and the Gateway seeming to shut down on its own. Error stacks from the gateway are below, would rea

[jira] [Commented] (APEXCORE-107) Support adding module to application using property file API.

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271510#comment-15271510 ] ASF GitHub Bot commented on APEXCORE-107: - Github user tushargosavi commented on

[GitHub] incubator-apex-core pull request: APEXCORE-107 Support for adding ...

2016-05-04 Thread tushargosavi
Github user tushargosavi commented on the pull request: https://github.com/apache/incubator-apex-core/pull/313#issuecomment-217016767 Merged GenericOperatorMeta with OperatorMeta. ModuleMeta extends from OpeartorMeta. We can merge ModuleMeta and keep a single OperatorMeta but that w

[GitHub] incubator-apex-malhar pull request: REVIEW ONLY: APEXCORE-442 Remo...

2016-05-04 Thread davidyan74
Github user davidyan74 closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/256 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Commented] (APEXCORE-442) Remove "incubation" and its variants from our code base

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271439#comment-15271439 ] ASF GitHub Bot commented on APEXCORE-442: - Github user davidyan74 closed the pul

[jira] [Commented] (APEXMALHAR-2079) expireStreamAfterAccessMillis property not getting set

2016-05-04 Thread venkatesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271434#comment-15271434 ] venkatesh commented on APEXMALHAR-2079: --- Yes Chandini, that works. Thank You.

[jira] [Updated] (APEXMALHAR-2079) expireStreamAfterAccessMillis property not getting set

2016-05-04 Thread venkatesh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkatesh updated APEXMALHAR-2079: -- Priority: Minor (was: Major) > expireStreamAfterAccessMillis property not getting set > --

[jira] [Comment Edited] (APEXMALHAR-2079) expireStreamAfterAccessMillis property not getting set

2016-05-04 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271419#comment-15271419 ] Chandni Singh edited comment on APEXMALHAR-2079 at 5/4/16 9:02 PM:

[jira] [Created] (APEXMALHAR-2080) File expiration time is set too low by default in AbstractFileOutputOperator.

2016-05-04 Thread Tushar Gosavi (JIRA)
Tushar Gosavi created APEXMALHAR-2080: - Summary: File expiration time is set too low by default in AbstractFileOutputOperator. Key: APEXMALHAR-2080 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2080

[jira] [Commented] (APEXMALHAR-2079) expireStreamAfterAccessMillis property not getting set

2016-05-04 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271419#comment-15271419 ] Chandni Singh commented on APEXMALHAR-2079: --- in the configuration if you ha

[jira] [Assigned] (APEXMALHAR-2079) expireStreamAfterAccessMillis property not getting set

2016-05-04 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned APEXMALHAR-2079: - Assignee: Chandni Singh > expireStreamAfterAccessMillis property not getting

[jira] [Created] (APEXMALHAR-2079) expireStreamAfterAccessMillis property not getting set

2016-05-04 Thread venkatesh (JIRA)
venkatesh created APEXMALHAR-2079: - Summary: expireStreamAfterAccessMillis property not getting set Key: APEXMALHAR-2079 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2079 Project: Apache Apex

[jira] [Commented] (APEXCORE-330) Ability to obtain a thread dump from a container

2016-05-04 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271358#comment-15271358 ] Pramod Immaneni commented on APEXCORE-330: -- I noticed that the individual conta

[jira] [Issue Comment Deleted] (APEXCORE-405) Provide an API to launch DAG on the cluster

2016-05-04 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pramod Immaneni updated APEXCORE-405: - Comment: was deleted (was: I noticed that the individual containers are sending a JSON s

[jira] [Commented] (APEXCORE-405) Provide an API to launch DAG on the cluster

2016-05-04 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271356#comment-15271356 ] Pramod Immaneni commented on APEXCORE-405: -- I noticed that the individual conta

[GitHub] incubator-apex-core pull request: Documentation for Affinity Rules

2016-05-04 Thread tweise
Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-core/pull/324#issuecomment-216980867 @ishark thanks for adding the documentation! I added a few minor tweaks on top of it. --- If your project is set up for it, you can reply to this email and

[jira] [Commented] (APEXCORE-442) Remove "incubation" and its variants from our code base

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271322#comment-15271322 ] ASF GitHub Bot commented on APEXCORE-442: - Github user davidyan74 closed the pul

[GitHub] incubator-apex-core pull request: REVIEW ONLY: APEXCORE-442 Remove...

2016-05-04 Thread davidyan74
GitHub user davidyan74 reopened a pull request: https://github.com/apache/incubator-apex-core/pull/317 REVIEW ONLY: APEXCORE-442 Removed incubating For review only. Do not merge until our mailing list address and our repository names are updated You can merge this pull request into

[jira] [Commented] (APEXCORE-442) Remove "incubation" and its variants from our code base

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271323#comment-15271323 ] ASF GitHub Bot commented on APEXCORE-442: - GitHub user davidyan74 reopened a pul

[GitHub] incubator-apex-core pull request: REVIEW ONLY: APEXCORE-442 Remove...

2016-05-04 Thread davidyan74
Github user davidyan74 closed the pull request at: https://github.com/apache/incubator-apex-core/pull/317 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] incubator-apex-core pull request: Documentation for Affinity Rules

2016-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/324 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-apex-core pull request: Documentation for Affinity Rules

2016-05-04 Thread tweise
Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/324#discussion_r62100615 --- Diff: docs/application_development.md --- @@ -1732,6 +1732,84 @@ the network card. THREAD_LOCAL and CONTAINER_LOCAL streams do not use a b

[jira] [Commented] (APEXCORE-427) Unit test testAppDataPush fails on Travis

2016-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271275#comment-15271275 ] ASF GitHub Bot commented on APEXCORE-427: - Github user asfgit closed the pull re

[GitHub] incubator-apex-core pull request: APEXCORE-427 disable tests that ...

2016-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/323 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Updated] (APEXCORE-427) Unit test testAppDataPush fails on Travis

2016-05-04 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/APEXCORE-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXCORE-427: -- Fix Version/s: (was: 3.4.0) > Unit test testAppDataPush fails on Travis >

Re: Enhancements in JdbcPOJOInputOperator

2016-05-04 Thread Priyanka Gugale
Java many times preserve date as long and then we can convert it the way we want when we need to interface with other systems (like UI, DB or etc). We can still do conversion from one date format to other, but I would prefer to keep it raw and convert in required format when need arise. -Priyanka

[jira] [Created] (APEXMALHAR-2078) Potential thread issue in FileSplitterInput class

2016-05-04 Thread Priyanka Gugale (JIRA)
Priyanka Gugale created APEXMALHAR-2078: --- Summary: Potential thread issue in FileSplitterInput class Key: APEXMALHAR-2078 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2078 Project: Apach

Re: NFS Input Module

2016-05-04 Thread Chandni Singh
Hi Chaitanya, What will be specific in NFS Input Module that is not provided by FS Input Module? Thanks, Chandni On Wed, May 4, 2016 at 7:12 AM, Amol Kekre wrote: > +1 > > Thks > Amol > > On Tue, May 3, 2016 at 10:06 PM, Sandeep Deshmukh > > wrote: > > > +1 > > > > Regards, > > Sandeep > > >

Re: NFS Input Module

2016-05-04 Thread Amol Kekre
+1 Thks Amol On Tue, May 3, 2016 at 10:06 PM, Sandeep Deshmukh wrote: > +1 > > Regards, > Sandeep > > On Fri, Apr 29, 2016 at 3:26 PM, Mohit Jotwani > wrote: > > > +1 > > > > Regards, > > Mohit > > > > On Fri, Apr 29, 2016 at 2:09 PM, Chaitanya Chebolu < > > chaita...@datatorrent.com> wrote: >

[jira] [Created] (APEXMALHAR-2077) SingleFileOutputOperator should append partitionId to file name

2016-05-04 Thread Yogi Devendra (JIRA)
Yogi Devendra created APEXMALHAR-2077: - Summary: SingleFileOutputOperator should append partitionId to file name Key: APEXMALHAR-2077 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2077 Pro

[GitHub] incubator-apex-core pull request: Documentation for Affinity Rules

2016-05-04 Thread ishark
GitHub user ishark opened a pull request: https://github.com/apache/incubator-apex-core/pull/324 Documentation for Affinity Rules Have added it in Application development guide after Streams section. You can merge this pull request into a Git repository by running: $ git pull h