Re: Not catching exceptions from down stream operator

Hi All, Created Sample application for THREAD_LOCAL issue. Application is here . Application has the following DAG: RandomEventGenerator -> OuputOperator. Both the operators are THREAD_LOCAL. In OutputOperator, throwing exceptio

Re: Support for Anti-Affinity in Apex

Hi Isha, 2 ways looks fine. Just one point, how would user set affinity rules using DAG content attribute from properties.xml file? Can you please provide some example for this? Thanks, Chinmay. On Fri, Feb 26, 2016 at 2:57 AM, Isha Arkatkar wrote: > Thanks for the input Chinmay. > > The las

Re: [DISCUSS] Apache Apex Malhar Release 3.3.1-incubating (RC1)

Hi, > The maven artifacts include the sources, tests and javadoc jars. Thanks for that just checking that noting more was included. Thanks, Justin

Re: [DICUSS] Apache Apex Malhar Release 3.3.1-incubating (RC1)

Hi Justin, The maven artifacts include the sources, tests and javadoc jars. Here is the link to the staging: > Maven staging repository: > https://repository.apache.org/content/repositories/orgapacheapex-1008 > Thanks, -Bhupesh On Fri, Feb 26, 2016 at 7:13 AM, Justin Mclean wrote: > Hi, > >

Re: JVM options for App Master

Sorry, I misread. Not sure about CONTAINER_JVM_OPTIONS. On Fri, Feb 26, 2016 at 8:24 AM, Bhupesh Chawda wrote: > Hi Ram, > > We have "MASTER_MEMORY_MB" as a parameter in DagContext. > Perhaps dt.MASTER_MEMORY_MB or > dt.application..attr.MASTER_MEMORY_MB should work. > > -Bhupesh > > On Fri, Feb

Re: JVM options for App Master

Hi Ram, We have "MASTER_MEMORY_MB" as a parameter in DagContext. Perhaps dt.MASTER_MEMORY_MB or dt.application..attr.MASTER_MEMORY_MB should work. -Bhupesh On Fri, Feb 26, 2016 at 1:08 AM, Munagala Ramanath wrote: > Do we have a property for specifying JVM options for the App Master alone ? >

[DICUSS] Apache Apex Malhar Release 3.3.1-incubating (RC1)

Hi, > This is a source release with binary artifacts published to Maven. Can you clarify that a little please. What exactly is published to maven? Just the compiled source jars or something more? Thanks, Justin

[jira] [Resolved] (APEXCORE-359) Add clean-app-directories command to CLI to clean up data of terminated apps

[ https://issues.apache.org/jira/browse/APEXCORE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXCORE-359. Resolution: Fixed > Add clean-app-directories command to CLI to clean up data of terminated apps >

[GitHub] incubator-apex-core pull request: APEX-246 Checkpoint distance pul...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/232 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-apex-core pull request: APEX-246 Checkpoint distance pul...

Github user PramodSSImmaneni commented on the pull request: https://github.com/apache/incubator-apex-core/pull/232#issuecomment-189050979 squashed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[jira] [Created] (APEXCORE-360) Add capability in the engine to let the operator know about the next checkpoint window

Pramod Immaneni created APEXCORE-360: Summary: Add capability in the engine to let the operator know about the next checkpoint window Key: APEXCORE-360 URL: https://issues.apache.org/jira/browse/APEXCORE-360

[jira] [Updated] (APEXCORE-360) Add capability in the engine to let the operator know about the next checkpoint window

[ https://issues.apache.org/jira/browse/APEXCORE-360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pramod Immaneni updated APEXCORE-360: - Issue Type: Improvement (was: Bug) > Add capability in the engine to let the operator k

[GitHub] incubator-apex-core pull request: APEX-246 Checkpoint distance pul...

Github user davidyan74 commented on the pull request: https://github.com/apache/incubator-apex-core/pull/232#issuecomment-189031685 I'm okay with the changes. Do you want to squash the commits? --- If your project is set up for it, you can reply to this email and have your reply app

[jira] [Resolved] (APEXCORE-352) Temp directories/files not created in temp directory specified by system property java.io.tmpdir

[ https://issues.apache.org/jira/browse/APEXCORE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXCORE-352. Resolution: Fixed > Temp directories/files not created in temp directory specified by system > pr

[jira] [Updated] (APEXCORE-359) Add clean-app-directories command to CLI to clean up data of terminated apps

[ https://issues.apache.org/jira/browse/APEXCORE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXCORE-359: --- Fix Version/s: 3.4.0 > Add clean-app-directories command to CLI to clean up data of terminated apps

[GitHub] incubator-apex-core pull request: APEXCORE-359 #resolve added clea...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/241 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Commented] (APEXCORE-359) Add clean-app-directories command to CLI to clean up data of terminated apps

[ https://issues.apache.org/jira/browse/APEXCORE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15168064#comment-15168064 ] ASF GitHub Bot commented on APEXCORE-359: - Github user asfgit closed the pull re

Re: [VOTE] Apache Apex Malhar Release 3.3.1-incubating (RC1)

+1 (binding) I downloaded the source tarball, did the rat-check, ran unit tests (no failures), and launched pi-demo in my one-node cluster. Would be nice to include the string "apex" in the file names of the zip and tarballs. Right now it's malhar-3.3.1-incubating-source-release.tar.gz. I recom

[jira] [Commented] (APEXCORE-359) Add clean-app-directories command to CLI to clean up data of terminated apps

[ https://issues.apache.org/jira/browse/APEXCORE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167964#comment-15167964 ] ASF GitHub Bot commented on APEXCORE-359: - Github user davidyan74 commented on t

[GitHub] incubator-apex-core pull request: APEXCORE-359 #resolve added clea...

Github user davidyan74 commented on the pull request: https://github.com/apache/incubator-apex-core/pull/241#issuecomment-189005820 @ishark please review and merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (APEXCORE-359) Add clean-app-directories command to CLI to clean up data of terminated apps

[ https://issues.apache.org/jira/browse/APEXCORE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167947#comment-15167947 ] ASF GitHub Bot commented on APEXCORE-359: - GitHub user davidyan74 opened a pull

[GitHub] incubator-apex-core pull request: APEXCORE-359 #resolve added clea...

GitHub user davidyan74 opened a pull request: https://github.com/apache/incubator-apex-core/pull/241 APEXCORE-359 #resolve added clean-app-directories command to clean up… … terminated apps You can merge this pull request into a Git repository by running: $ git pull https:/

[jira] [Created] (APEXCORE-359) Add clean-app-directories command to CLI to clean up data of terminated apps

David Yan created APEXCORE-359: -- Summary: Add clean-app-directories command to CLI to clean up data of terminated apps Key: APEXCORE-359 URL: https://issues.apache.org/jira/browse/APEXCORE-359 Project: A

[jira] [Resolved] (APEXMALHAR-2003) NPE in FileSplitterInput

[ https://issues.apache.org/jira/browse/APEXMALHAR-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXMALHAR-2003. -- Resolution: Fixed > NPE in FileSplitterInput > > >

[jira] [Updated] (APEXMALHAR-2003) NPE in FileSplitterInput

[ https://issues.apache.org/jira/browse/APEXMALHAR-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated APEXMALHAR-2003: - Fix Version/s: 3.4.0 > NPE in FileSplitterInput > > >

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2003 NPE in blockMe...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/201 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2003) NPE in FileSplitterInput

[ https://issues.apache.org/jira/browse/APEXMALHAR-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167934#comment-15167934 ] ASF GitHub Bot commented on APEXMALHAR-2003: Github user asfgit closed th

[jira] [Commented] (APEXCORE-60) Iterative processing support

[ https://issues.apache.org/jira/browse/APEXCORE-60?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167927#comment-15167927 ] ASF GitHub Bot commented on APEXCORE-60: Github user asfgit closed the pull reque

[GitHub] incubator-apex-malhar pull request: APEXCORE-60 added iteration de...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/177 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Support for Anti-Affinity in Apex

Thanks for the input Chinmay. The last parameter true/false is for relaxing the constraint. If true, the affinity rule would be relaxed if constraint cannot be satisfied. And if false, application will keep requesting and waiting to launch containers till all rules are satisfied. Regarding the da

JVM options for App Master

Do we have a property for specifying JVM options for the App Master alone ? We can do it for all containers with: *dt.attr.CONTAINER_JVM_OPTIONS* we can do it for specific operators with: *dt.operator..attr.JVM_OPTIONS* ... etc. But how about for the App Master ? Ram

[jira] [Assigned] (APEXCORE-358) Make RPC timeout configurable

[ https://issues.apache.org/jira/browse/APEXCORE-358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov reassigned APEXCORE-358: --- Assignee: Vlad Rozov > Make RPC timeout configurable > - > >

[jira] [Created] (APEXCORE-358) Make RPC timeout configurable

Vlad Rozov created APEXCORE-358: --- Summary: Make RPC timeout configurable Key: APEXCORE-358 URL: https://issues.apache.org/jira/browse/APEXCORE-358 Project: Apache Apex Core Issue Type: Improvem

[GitHub] incubator-apex-malhar pull request: SPOI-7087 #resolve #comment Ad...

GitHub user brightchen reopened a pull request: https://github.com/apache/incubator-apex-malhar/pull/194 SPOI-7087 #resolve #comment Add JDBC dimension output operator to Malhar You can merge this pull request into a Git repository by running: $ git pull https://github.com/bri

[GitHub] incubator-apex-malhar pull request: SPOI-7087 #resolve #comment Ad...

Github user brightchen closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/194 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Resolved] (APEXCORE-353) Buffer server may stop processing data

[ https://issues.apache.org/jira/browse/APEXCORE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Rozov resolved APEXCORE-353. - Resolution: Fixed Fix Version/s: 3.3.1 3.4.0 3.2.1

[GitHub] incubator-apex-malhar pull request: MLHR-1897 #comment added manag...

Github user chandnisingh commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/145#discussion_r54147037 --- Diff: library/src/main/java/com/datatorrent/lib/state/BucketedState.java --- @@ -0,0 +1,101 @@ +/** + * Licensed to the Apach

[GitHub] incubator-apex-malhar pull request: MLHR-1897 #comment added manag...

Github user PramodSSImmaneni commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/145#discussion_r54145912 --- Diff: library/src/main/java/com/datatorrent/lib/state/BucketedState.java --- @@ -0,0 +1,101 @@ +/** + * Licensed to the A

[jira] [Commented] (APEXCORE-353) Buffer server may stop processing data

[ https://issues.apache.org/jira/browse/APEXCORE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167590#comment-15167590 ] ASF GitHub Bot commented on APEXCORE-353: - Github user tweise commented on the p

[GitHub] incubator-apex-core pull request: APEXCORE-353

Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-core/pull/237#issuecomment-188919520 Mark the JIRA resolved then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] incubator-apex-core pull request: APEXCORE-353

Github user PramodSSImmaneni commented on the pull request: https://github.com/apache/incubator-apex-core/pull/237#issuecomment-188916325 Already done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Commented] (APEXCORE-353) Buffer server may stop processing data

[ https://issues.apache.org/jira/browse/APEXCORE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167568#comment-15167568 ] ASF GitHub Bot commented on APEXCORE-353: - Github user PramodSSImmaneni commente

[jira] [Commented] (APEXCORE-353) Buffer server may stop processing data

[ https://issues.apache.org/jira/browse/APEXCORE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167558#comment-15167558 ] ASF GitHub Bot commented on APEXCORE-353: - Github user tweise commented on the p

[GitHub] incubator-apex-core pull request: APEXCORE-353

Github user tweise commented on the pull request: https://github.com/apache/incubator-apex-core/pull/237#issuecomment-188911689 @PramodSSImmaneni please cherry pick into all versions listed in JIRA. --- If your project is set up for it, you can reply to this email and have your repl

Re: Regarding Twitter Demo - Apache Apex.

Hey Sairam, It looks like your console didn't pick up the right configuration file. The global configuration will be overwritten by the files in the package. There are several ways to set the property 1. You can specify configuration file when you launch the application "launch xxx.apa -conf $your

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2003 NPE in blockMe...

GitHub user chandnisingh opened a pull request: https://github.com/apache/incubator-apex-malhar/pull/201 APEXMALHAR-2003 NPE in blockMetaDataIterator after recovery You can merge this pull request into a Git repository by running: $ git pull https://github.com/chandnisingh/inc

[jira] [Commented] (APEXMALHAR-2003) NPE in FileSplitterInput

[ https://issues.apache.org/jira/browse/APEXMALHAR-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167503#comment-15167503 ] ASF GitHub Bot commented on APEXMALHAR-2003: GitHub user chandnisingh ope

[jira] [Commented] (APEXMALHAR-2003) NPE in FileSplitterInput

[ https://issues.apache.org/jira/browse/APEXMALHAR-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167501#comment-15167501 ] ASF GitHub Bot commented on APEXMALHAR-2003: Github user chandnisingh clo

[GitHub] incubator-apex-malhar pull request: APEXMALHAR-2003 NPE in blockMe...

Github user chandnisingh closed the pull request at: https://github.com/apache/incubator-apex-malhar/pull/198 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[jira] [Commented] (APEXCORE-353) Buffer server may stop processing data

[ https://issues.apache.org/jira/browse/APEXCORE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167487#comment-15167487 ] ASF GitHub Bot commented on APEXCORE-353: - Github user asfgit closed the pull re

[GitHub] incubator-apex-core pull request: APEXCORE-353

Github user asfgit closed the pull request at: https://github.com/apache/incubator-apex-core/pull/237 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

Re: [VOTE] Apache Apex Malhar Release 3.3.1-incubating (RC1)

+1 Followed instructions on http://apex.incubator.apache.org/verification.html and performed following checks: 1. Integrity of files: OK 2. No binary file found in the released sources: OK 3. DISCLAIMER, LICENSE, NOTICE, README.md and CHANGELOG.md files: OK 4. Compilation, license hea

[VOTE] Apache Apex Malhar Release 3.3.1-incubating (RC1)

Dear Community, Please vote on the following Apache Apex Malhar 3.3.1-incubating release candidate. This patch release addresses important bugs in Kafka input connector and stabilizes IdempotentStorageManager. Also fixes local mode execution of operators which use Kryo and an NPE in AbstractFileS

[jira] [Created] (APEXCORE-357) AppMaster not catching exceptions from downstream operator, if upstream and downstream are of THREAD_LOCAL

Chaitanya created APEXCORE-357: -- Summary: AppMaster not catching exceptions from downstream operator, if upstream and downstream are of THREAD_LOCAL Key: APEXCORE-357 URL: https://issues.apache.org/jira/browse/APEXCO