RE: [VOTE]add committer into Eagle project

[Krishna, Murali(AWF)]

+1

- Murali Krishna

-Original Message-
From: Edward Zhang [mailto:yonzhang2...@apache.org] 
Sent: Tuesday, January 26, 2016 2:51 PM
To: dev@eagle.incubator.apache.org; u...@eagle.incubator.apache.org
Subject: [VOTE]add committer into Eagle project

Hi Eagle Community,

I would like to nominate Liangfei(Ralph), Su to be Eagle committer based on his 
continuous contribution in last 2 months. The detail is as follows:

https://issues.apache.org/jira/browse/EAGLE-85
https://issues.apache.org/jira/browse/EAGLE-88
https://issues.apache.org/jira/browse/EAGLE-108
https://issues.apache.org/jira/browse/EAGLE-128
https://issues.apache.org/jira/browse/EAGLE-136
https://issues.apache.org/jira/browse/EAGLE-79


Among which, Eagle-79 metric aggregation siddhi support is a critical feature 
for Eagle to support declarative metric aggregation. Also Eagle-136 hadoop 
metric monitoring is also an important feature for Eagle to monitor hadoop with 
jmx metric.

Also Ralph active participated in various discussions and contributed some 
design documents for example 
https://cwiki.apache.org/confluence/display/EAG/Stream+Analyze.

Please vote.

Thanks
Edward

Cannot compile unknown AlertExecutor to a Storm Spout

[Krishna, Murali(AWF)]

Hi Team,

Running into below error when I run HdfsAuditLogProcessorMain. Using the 
sandbox-hdfsAuditLog-application.conf from assembly module as input to this.
Can someone point me in the right direction.

Exception in thread "main" java.lang.IllegalArgumentException: Cannot compile 
unknown AlertExecutor to a Storm Spout
at 
org.apache.eagle.datastream.storm.StormSpoutFactory$.createSpout(StormSpoutFactory.scala:43)
at 
org.apache.eagle.datastream.storm.StormTopologyCompiler.buildTopology(StormTopologyCompiler.scala:47)
at 
org.apache.eagle.datastream.storm.StormExecutionEnvironment.execute(StormExecutionEnvironment.scala:29)
at 
org.apache.eagle.datastream.core.StreamContextAdapter$class.submit(ExecutionEnvironment.scala:25)
at 
org.apache.eagle.datastream.core.ExecutionEnvironment.submit(ExecutionEnvironment.scala:35)
at 
org.apache.eagle.datastream.core.StreamContext.submit(StreamBuilder.scala:67)
at 
org.apache.eagle.datastream.core.ExecutionEnvironment.execute(ExecutionEnvironment.scala:43)
at 
org.apache.eagle.security.auditlog.HdfsAuditLogProcessorMain.execWithBalancedPartition(HdfsAuditLogProcessorMain.java:100)
at 
org.apache.eagle.security.auditlog.HdfsAuditLogProcessorMain.main(HdfsAuditLogProcessorMain.java:109)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)

Thanks,
Murali Krishna

RE: Cannot compile unknown AlertExecutor to a Storm Spout

[Krishna, Murali(AWF)]

Thanks Hao.

- Murali Krishna

-Original Message-
From: Chen, Hao [mailto:hao.ch...@ebay.com] 
Sent: Thursday, January 21, 2016 4:51 PM
To: dev@eagle.incubator.apache.org
Subject: Re: Cannot compile unknown AlertExecutor to a Storm Spout

Resolved: https://github.com/apache/incubator-eagle/pull/70


On 1/21/16, 6:53 PM, "Chen, Hao" <hao.ch...@ebay.com> wrote:

>Thanks for reporting it, I will investigate the root cause.
>
>Thanks,
>Hao
>
>
>
>
>On 1/21/16, 6:48 PM, "Krishna, Murali(AWF)" <murkris...@ebay.com> wrote:
>
>>Hi Team,
>>
>>Running into below error when I run HdfsAuditLogProcessorMain. Using the 
>>sandbox-hdfsAuditLog-application.conf from assembly module as input to this.
>>Can someone point me in the right direction.
>>
>>Exception in thread "main" java.lang.IllegalArgumentException: Cannot compile 
>>unknown AlertExecutor to a Storm Spout
>>at 
>> org.apache.eagle.datastream.storm.StormSpoutFactory$.createSpout(StormSpoutFactory.scala:43)
>>at 
>> org.apache.eagle.datastream.storm.StormTopologyCompiler.buildTopology(StormTopologyCompiler.scala:47)
>>at 
>> org.apache.eagle.datastream.storm.StormExecutionEnvironment.execute(StormExecutionEnvironment.scala:29)
>>at 
>> org.apache.eagle.datastream.core.StreamContextAdapter$class.submit(ExecutionEnvironment.scala:25)
>>at 
>> org.apache.eagle.datastream.core.ExecutionEnvironment.submit(ExecutionEnvironment.scala:35)
>>at 
>> org.apache.eagle.datastream.core.StreamContext.submit(StreamBuilder.scala:67)
>>at 
>> org.apache.eagle.datastream.core.ExecutionEnvironment.execute(ExecutionEnvironment.scala:43)
>>at 
>> org.apache.eagle.security.auditlog.HdfsAuditLogProcessorMain.execWithBalancedPartition(HdfsAuditLogProcessorMain.java:100)
>>at 
>> org.apache.eagle.security.auditlog.HdfsAuditLogProcessorMain.main(HdfsAuditLogProcessorMain.java:109)
>>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>at 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>at 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>at java.lang.reflect.Method.invoke(Method.java:606)
>>at 
>> com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
>>
>>Thanks,
>>Murali Krishna

RE: [Welcome] New Contributors in Apache Eagle

[Krishna, Murali(AWF)]

Thank you Arun and Edward :)
Looking forward to contribute more.

- Murali Krishna

-Original Message-
From: Edward Zhang [mailto:yonzhang2...@apache.org] 
Sent: Thursday, January 14, 2016 12:06 PM
To: dev@eagle.incubator.apache.org
Subject: Re: [Welcome] New Contributors in Apache Eagle

Welcome Murali and Zhaokun. I know you have done a lot :-)

thanks
Edward

On Wed, Jan 13, 2016 at 10:27 PM, arunkarthick m 
wrote:

> Welcome Murali and Zhaokun Qin. Thanks for your contributions.
>
> Looking forward to be working with you.
>
> Regards,
> Arun
>
> On Wed, Jan 13, 2016 at 9:29 PM, Michael Wu  wrote:
>
> > It's my pleasure, team. Thanks for your words. 
> >
> > On Wed, Jan 13, 2016 at 7:04 PM, Hao Chen  wrote:
> >
> > > Welcome Zhaokun Qin as well, who has made great contributions for 
> > > eagle docker image.
> > >
> > > Regards,
> > > Hao
> > >
> > > On Wed, Jan 13, 2016 at 4:17 PM, Prasad Mujumdar 
> > > 
> > > wrote:
> > >
> > > >   Thanks!
> > > > Looking forward to work with the community to make better
> > contributions!
> > > >
> > > > thanks
> > > > Prasad
> > > >
> > > >
> > > > On Tue, Jan 12, 2016 at 3:45 PM, Arun Manoharan <
> > > arunmanoha...@apache.org>
> > > > wrote:
> > > >
> > > > > Hi Everyone,
> > > > >
> > > > > In the last 2 months we have had some increasing participation 
> > > > > and
> > > active
> > > > > discussions from the community on various topics.
> > > > >
> > > > > I would like to thank Prasad Mujumdar, Ralph Su, Michael Wu, 
> > > > > Daniel
> > > Zhou
> > > > > for their contributions to the project.
> > > > >
> > > > > Thanks,
> > > > > Arun
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Arun Karthick
> 201-850-9399
>

EAGLE-95 design

[Krishna, Murali(AWF)]

Hi Team,

Would like your input/review on the design proposed for 
EAGLE-95 available in this 
Wiki.
The objective is to mark down policies that are identified as invalid and be 
skipped during the start of a topology.

We can use SiddhiCompiler.parseQuery() to validate the policy mentioned in the 
alertdef expression.
The above can be done at the AlertExecutor class while creating evaluator 
objects, on methods - init(), onPolicyCreated() and onPolicyChanged()
The same can be updated in the alertdef table for the corresponding policy by 
adding columns - markdown and markdownReason. This can be shown in the UI for 
the user to know what is wrong with the policy.

During the preparation of the PolicyEvaluator map available in AlertExecutor, 
we can add/modify/delete entries for policy IDs based on the output of the 
parseQuery().


-  Murali Krishna

RE: query in merge process

[Krishna, Murali(AWF)]

Thanks Edward.

- Murali Krishna

-Original Message-
From: Zhang, Edward (GDI Hadoop) [mailto:yonzh...@ebay.com] 
Sent: Thursday, December 31, 2015 12:34 AM
To: dev@eagle.incubator.apache.org
Subject: Re: query in merge process

Hi Murali,

Right now, probably you don¹t have merging privilege. I can merge the pull 
request https://github.com/apache/incubator-eagle/pull/39 on behalf of you 
today. I think you will have privilege once after you are committer. That would 
need some votes based on some merits according to apache way.

Thanks
Edward

On 12/30/15, 2:43, "Krishna, Murali(AWF)" <murkris...@ebay.com> wrote:

>Hi Team,
>
>Can anyone help with the procedure to get access for merging a PR to 
>master.
>(Following the procedure mentioned in this 
>Wiki<https://cwiki.apache.org/confluence/display/EAG/Contributing+to+Ea
>gle
>>)
>
>Thanks,
>Murali Krishna

query in merge process

[Krishna, Murali(AWF)]

Hi Team,

Can anyone help with the procedure to get access for merging a PR to master.
(Following the procedure mentioned in this 
Wiki)

Thanks,
Murali Krishna

create/update differentiation in eagle service API

[Krishna, Murali(AWF)]

Hi Team,

The question is in terms of https://issues.apache.org/jira/browse/EAGLE-47

In the eagle services for PolicyDefinition and DataSourceDefinition, both the 
create and update operations go through the create method of HBaseStorage.java. 
So how do we differentiate between create and update operation without hitting 
HBase again to check if the row exists (is this acceptable from the point of 
performance). Or is there any other way to differentiate ?

Thanks,
Murali Krishna

RE: create/update differentiation in eagle service API

[Krishna, Murali(AWF)]

Thanks Edward.

- Murali Krishna

-Original Message-
From: Zhang, Edward (GDI Hadoop) [mailto:yonzh...@ebay.com] 
Sent: Wednesday, December 23, 2015 11:18 AM
To: dev@eagle.incubator.apache.org
Subject: Re: create/update differentiation in eagle service API

Hi Murali,

There is no easy way to distinguish create and update. But looks it is not that 
important to know if policy is created or updated. If we do want to know if it 
is created or updated, we can look at the policy¹s history and the first change 
must be create.

Thanks
Edward

On 12/22/15, 20:48, "Krishna, Murali(AWF)" <murkris...@ebay.com> wrote:

>Hi Team,
>
>The question is in terms of 
>https://issues.apache.org/jira/browse/EAGLE-47
>
>In the eagle services for PolicyDefinition and DataSourceDefinition, 
>both the create and update operations go through the create method of 
>HBaseStorage.java. So how do we differentiate between create and update 
>operation without hitting HBase again to check if the row exists (is 
>this acceptable from the point of performance). Or is there any other 
>way to differentiate ?
>
>Thanks,
>Murali Krishna

RE: access request to edit the wiki page

[Krishna, Murali(AWF)]

Hi Hao,

I have signed and mailed the ICLA.

- Murali Krishna

-Original Message-
From: Hao Chen [mailto:h...@apache.org] 
Sent: Wednesday, December 16, 2015 12:07 PM
To: dev@eagle.incubator.apache.org
Subject: Re: access request to edit the wiki page

Murali,

Added you into wiki. And did you sign ICLA?

Regards,
Hao


On Wed, Dec 16, 2015 at 1:36 PM, Krishna, Murali(AWF) <murkris...@ebay.com>
wrote:

> Hi Team,
>
> Can someone provide me access to edit the Wiki @ 
> https://cwiki.apache.org/confluence/display/EAG/Design
> userId - murkrishna
>
> Thanks,
> Murali Krishna
>