Re: Question on System Alerts API

2016-12-07 Thread David Yan
Hi Eric: Can you send us the log entries of dtgateway.log when the 500 error happens? Assuming the application id is applications.application_1480063135007_0543, the payload for setting an alert for when an application is not in RUNNING state would be something like: { "condition": "_topic['app

Re: Example use of Windowed Merge Operator

2016-12-02 Thread David Yan
Chinmay: Not sure whether you have gotten your answer already. The assumption that was made for the KeyedWindowedMergeOperatorImpl was that the merge is on the key itself and that's why there is only one KeyT for the key parameter. InputT1 and InputT2 are the values associated with the KeyValPair

Re: datatorrent gateway application package problem

2016-09-28 Thread David Yan
>> On 9/28/16 14:43, d...@softiron.co.uk wrote: >> >>> On 2016-09-28 14:09, David Yan wrote: >>> >>>> dtgateway does not use the native libraries. >>>> >>>> I just tried a clean install of RTS 3.5.0 community edition on plain >>

Re: datatorrent gateway application package problem

2016-09-28 Thread David Yan
the hadoop native library doesn't build on SUSE/SLES ARM64, > so I'm running with the pure Java library. > > Is it possible that the dtgateway is trying to use the native library > directly? > > Thanks, > -david > > > On 2016-09-26 14:45, David Yan wrote:

Re: datatorrent gateway application package problem

2016-09-26 Thread David Yan
Added back users@ to the thread. On Mon, Sep 26, 2016 at 5:03 PM, David Yan wrote: > Can you try one of the released hadoop versions, like 2.7.3 or 2.7.2 or > 2.6.4? > We will check that sha commit on our side as well. > > David > > On Mon, Sep 26, 2016 at 4:40 PM, wrote:

Re: datatorrent gateway application package problem

2016-09-26 Thread David Yan
Also, one of the first steps in the installation wizard is to enter the hadoop location (the same screen as the DFS directory). Can you please double check the hadoop location points to the correct hadoop binary in your system? David On Mon, Sep 26, 2016 at 2:45 PM, David Yan wrote: > Do

Re: datatorrent gateway application package problem

2016-09-26 Thread David Yan
Do you see any exception stacktrace in the log when this error occurred: Wrong FS: hdfs://namenode:9000/user/dtadmin/datatorrent, expected: file:/// David On Mon, Sep 26, 2016 at 2:39 PM, wrote: > From David Yan >> DateSat 00:12 >> >> Can you please provide any ex

Re: datatorrent gateway application package problem

2016-09-24 Thread David Yan
Can you please provide any exception stacktrace in the dtgateway.log file when that happens? Thanks, David On Tue, Sep 13, 2016 at 4:06 PM, wrote: > I have the dtgateway running (community edition) with apex/malhar 3.4 and > hadoop 2.7.4 on SuSE SLES 12.1 on an ARM64 server (aarch64). > > In th

Re: Problem Uploading Package on Latest Version Clean Install

2016-09-13 Thread David Yan
Hi Jim, Is there any exception stack trace that was logged in the dtgateway.log file when the 500 error happened? If so, please send this to us so that we can take a look at what's wrong. Thanks! David On Tue, Sep 13, 2016 at 12:04 PM, Jim wrote: > Good afternoon, > > > > We had a few issues w

Re: Accessing dtGateway's REST API

2016-09-05 Thread David Yan
Hi Kimmy, You need to use a cookie jar in curl to do this. There is an example here: http://docs.datatorrent.com/dtgateway_security/#administering-using-command-line David On Sat, Sep 3, 2016 at 5:59 PM, Cummings, Kimmy < kimmy.cummi...@capitalone.com> wrote: > Hey Everyone, > > > > I’m writin

Re: Sharing Properties Between Operators

2016-08-01 Thread David Yan
Hi Alex, You can make multiple operators sharing the same property by doing something like this: your.own.property.name 127.0.0.1 dt.operator.opName1.prop.[property-name] ${your.own.property.name} dt.operator.opName2.prop.[property-name] ${your.own.property.name} Or you

Re: Packaging App with Shade

2016-07-13 Thread David Yan
Hi Alex, We have a shaded artifact for async-http-client in Apex. You can take a look here: https://github.com/apache/apex-core/blob/master/shaded-ning19/pom.xml You can use that as a reference on how to shade guava on your app package pom. Hope that helps. David On Wed, Jul 13, 2016 at 9:41

Re: A proposal for Malhar

2016-07-12 Thread David Yan
t; > >> On Tue, Jul 12, 2016 at 12:14 PM, Kottapalli, Venkatesh < > >> vkottapa...@directv.com> wrote: > >> > >>> +1 for deprecating the packages listed below. > >>> > >>> -Original Message- > >>> From: hsy..

Re: A proposal for Malhar

2016-07-12 Thread David Yan
and the layout of operators in Malhar in general and how it >causes problems with development. I will ask him to lead the discussion > on >that. > > Thanks > > On Fri, May 27, 2016 at 7:47 PM, David Yan wrote: > > > The two ideas are not conflicting, but r

Re: Support for Apex malhar 3.4.0 running on Data torrent

2016-07-07 Thread David Yan
apex-shaded-ning19 > > 1.0.0 > > > > > > net.sf.supercsv > > super-csv > > 2.3.1 > > > > > *Sushil Chaudhary* > *Cell #:* 408-466-200

Re: Support for Apex malhar 3.4.0 running on Data torrent

2016-07-06 Thread David Yan
Hi Sushil, We do have one backward incompatibility issue between Apex 3.3.x and Apex 3.4.x because of a security problem with a 3rd party library we depend on. Details are in the announcement email here: http://mail-archives.apache.org/mod_mbox/www-announce/201605.mbox/%3cca%2b5xao1zyso6azubjokpv

Re: Alerts

2016-06-22 Thread David Yan
Hi Raja, Apache Apex itself does not have that capability. But if you're using dtGateway in DataTorrent RTS, you have the following options: 1) Write your own program to poll dtGateway's REST API and write your logic based on the return values and fire an alert email when certain conditions are m