[jira] [Created] (EAGLE-843) Refactor application shared service registry framework

2016-12-16 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-843:
--

 Summary: Refactor application shared service registry framework
 Key: EAGLE-843
 URL: https://issues.apache.org/jira/browse/EAGLE-843
 Project: Eagle
  Issue Type: Improvement
Reporter: Hao Chen
Assignee: Hao Chen


Refactor application shared service registry framework



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-838) Resolve defunct process in hadoop jmx script by kill -9

2016-12-12 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-838:
--

 Summary: Resolve defunct process in hadoop jmx script by kill -9
 Key: EAGLE-838
 URL: https://issues.apache.org/jira/browse/EAGLE-838
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


* Resolve defunct process in hadoop jmx script by kill -9
* Support configurable log file path
* Improve JMX reader to multiple-threading



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-833) Add MetricSchemaGenerator and MetricSchemaService

2016-12-08 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-833:
--

 Summary: Add MetricSchemaGenerator and MetricSchemaService
 Key: EAGLE-833
 URL: https://issues.apache.org/jira/browse/EAGLE-833
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


* Add MetricSchemaService to store metric schema aside GenericMetric 
*Add MetricSchemaGenerator to automatically generate metric schema based on 
metric stream and metric definition.
 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-832) Support to define granularity for MetricDefinition to avoid metric duplicate

2016-12-08 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-832:
--

 Summary: Support to define granularity for MetricDefinition to 
avoid metric duplicate
 Key: EAGLE-832
 URL: https://issues.apache.org/jira/browse/EAGLE-832
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Support to define granularity for MetricDefinition to avoid metric duplicate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-825) Improve jmx collector with built-in metric filter

2016-12-06 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-825:
--

 Summary: Improve jmx collector with built-in metric filter
 Key: EAGLE-825
 URL: https://issues.apache.org/jira/browse/EAGLE-825
 Project: Eagle
  Issue Type: Improvement
Reporter: Hao Chen
Assignee: Hao Chen


* Support wildcard metric name filter
* Add built-in important metric name filter for hadoop and hbase 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-816) Fix host name bug in jmx collector scripts

2016-11-30 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-816:
--

 Summary: Fix host name bug in jmx collector scripts
 Key: EAGLE-816
 URL: https://issues.apache.org/jira/browse/EAGLE-816
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Fix host name bug in jmx collector scripts, which current always only use 
current fadn instead of configured host, it's a bug.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-815) Support alert template to generate human readable message

2016-11-29 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-815:
--

 Summary: Support alert template to generate human readable message 
 Key: EAGLE-815
 URL: https://issues.apache.org/jira/browse/EAGLE-815
 Project: Eagle
  Issue Type: New Feature
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Support alert template to generate human readable message 

* Support to define alert template in PolicyDefinition
* Support to generate alert message field based on policy'template and alert 
event
* Support persist alert message in AlertEntity as immutable field.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-807) Refactor JMX Metric Collector Script

2016-11-28 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-807:
--

 Summary: Refactor JMX Metric Collector Script
 Key: EAGLE-807
 URL: https://issues.apache.org/jira/browse/EAGLE-807
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Refactor JMX Metric Collector Script

* Support multiple kafka topics
* Support HA checking logic.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-806) Integrate Metric Process and Persistence with Application Framework

2016-11-28 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-806:
--

 Summary: Integrate Metric Process and Persistence with Application 
Framework
 Key: EAGLE-806
 URL: https://issues.apache.org/jira/browse/EAGLE-806
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Integrate Stream Source and Metric Persistence with Application Framework

* Provide API to easily ingest, process, aggregate and persist metric
* Integrate stream source
* Integrate metric definition and metric persistence.
* Implement basic plug-able aggregation abstraction for later usage.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-792) Resolve google-fonts external connection blocking problem in AdminLTE

2016-11-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-792:
--

 Summary: Resolve google-fonts external connection blocking problem 
in AdminLTE
 Key: EAGLE-792
 URL: https://issues.apache.org/jira/browse/EAGLE-792
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Jilin, Jiang
 Fix For: v0.5.0


Resolve google-fonts connection problem in AdminLTE when having no access to 
external network.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-791) Refactor eagle module names to be more meaningful

2016-11-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-791:
--

 Summary: Refactor eagle module names to be more meaningful 
 Key: EAGLE-791
 URL: https://issues.apache.org/jira/browse/EAGLE-791
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Refactor eagle module names to be more meaningful for developer to learn about 
eagle's code structure.

{code}
[INFO] Eagle::Parent .. SUCCESS [  0.204 s]
[INFO] Eagle::Core::Parent  SUCCESS [  0.003 s]
[INFO] Eagle::Core::DataProcess ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::Common  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert . SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::Core ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::Common . SUCCESS [  0.026 s]
[INFO] Eagle::Core::Alert::Engine . SUCCESS [  0.004 s]
[INFO] Eagle::Core::Alert::Metadata ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::MetadataBase ... SUCCESS [  0.003 s]
[INFO] Eagle::Core::Alert::MetadataService  SUCCESS [  0.003 s]
[INFO] Eagle::Core::Alert::Coordinator  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::Assembly ... SUCCESS [  0.003 s]
[INFO] Eagle::Core::Alert::DevTools ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::ServiceApp . SUCCESS [  0.001 s]
[INFO] Eagle::Core::Query::Parent . SUCCESS [  0.003 s]
[INFO] Eagle::Core::Query::Antlr .. SUCCESS [  0.002 s]
[INFO] Eagle::Core::Embed::Parent . SUCCESS [  0.002 s]
[INFO] Eagle::Core::Embed::HBase .. SUCCESS [  0.002 s]
[INFO] Eagle::Core::Query::EntityBase . SUCCESS [  0.002 s]
[INFO] Eagle::Core::Query::Base ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::Query::StorageBase  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Embed::Server . SUCCESS [  0.001 s]
[INFO] Eagle::Core::Client::Base .. SUCCESS [  0.003 s]
[INFO] Eagle::Core::Query::Audit .. SUCCESS [  0.001 s]
[INFO] Eagle::Core::Query::HBaseStorage ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::Service::Base . SUCCESS [  0.003 s]
[INFO] Eagle::Core::Metadata .. SUCCESS [  0.002 s]
[INFO] Eagle::Core::Metadata::Base  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::Service  SUCCESS [  0.003 s]
[INFO] Eagle::Core::App::Parent ... SUCCESS [  0.002 s]
[INFO] Eagle::Core::App::Base . SUCCESS [  0.002 s]
[INFO] Eagle::Core::Alert::AppProvider  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Query::JDBCStorage  SUCCESS [  0.003 s]
[INFO] Eagle::Core::Metric  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Metadata::JDBC  SUCCESS [  0.002 s]
[INFO] Eagle::Core::Metadata::MongoDB . SUCCESS [  0.001 s]
[INFO] Eagle::Core::App::Utils  SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::Parent ... SUCCESS [  0.002 s]
[INFO] Eagle::App::Security::Common ... SUCCESS [  0.002 s]
[INFO] Eagle::App::Security::HdfsAuditLog . SUCCESS [  0.002 s]
[INFO] Eagle::App::Security::MapRFSAuditLog ... SUCCESS [  0.001 s]
[INFO] Eagle::App::JPM::Parent  SUCCESS [  0.002 s]
[INFO] Eagle::App::JPM::Utils . SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::HiveSecurity . SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::HiveService .. SUCCESS [  0.002 s]
[INFO] Eagle::App::Security::HdfsService .. SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::MapRFSService  SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::HdfsAuthLog .. SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::HBaseAuditLog  SUCCESS [  0.002 s]
[INFO] Eagle::App::Security::HBaseService . SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::MetricCollection . SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::OozieAuditLog  SUCCESS [  0.001 s]
[INFO] Eagle::App::Security::OozieService . SUCCESS [  0.001 s]
[INFO] Eagle::External::Parent  SUCCESS [  0.001 s]
[INFO] Eagle::External::Log4jKafkaAppender  SUCCESS 

[jira] [Resolved] (EAGLE-769) InjectMembers in ServerApplication when initialization

2016-11-14 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-769.

Resolution: Fixed

> InjectMembers in ServerApplication when initialization
> --
>
> Key: EAGLE-769
> URL: https://issues.apache.org/jira/browse/EAGLE-769
> Project: Eagle
>  Issue Type: Improvement
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> InjectMembers in ServerApplication when initialization



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-769) InjectMembers in ServerApplication when initialization

2016-11-14 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-769:
--

 Summary: InjectMembers in ServerApplication when initialization
 Key: EAGLE-769
 URL: https://issues.apache.org/jira/browse/EAGLE-769
 Project: Eagle
  Issue Type: Improvement
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


InjectMembers in ServerApplication when initialization



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-766) Set default host&port of JPM_WEB_APP as null

2016-11-14 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-766:
---
Summary: Set default host&port of JPM_WEB_APP as null  (was: Set default 
host&port of JPM_WEB_APP as N/A)

> Set default host&port of JPM_WEB_APP as null
> 
>
> Key: EAGLE-766
> URL: https://issues.apache.org/jira/browse/EAGLE-766
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
> Fix For: v0.5.0
>
>
> Set default host & port of JPM_WEB_APP as N/A to make sure the web will read 
> web service from configured instead of always using current.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-766) Set default host&port of JPM_WEB_APP as N/A

2016-11-14 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-766:
--

 Summary: Set default host&port of JPM_WEB_APP as N/A
 Key: EAGLE-766
 URL: https://issues.apache.org/jira/browse/EAGLE-766
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
 Fix For: v0.5.0


Set default host & port of JPM_WEB_APP as N/A to make sure the web will read 
web service from configured instead of always using current.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-5) Minimal general-purpose monitoring engine

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-5.
--
Resolution: Fixed

> Minimal general-purpose monitoring engine 
> --
>
> Key: EAGLE-5
> URL: https://issues.apache.org/jira/browse/EAGLE-5
> Project: Eagle
>  Issue Type: New Feature
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> As the first step, we should allow traditional monitoring 'users' to
> 1. Create kafka topic say
> 2. Configure stream on UI
> 3. Start generic KafkaStreamMonitor topology pointing to the kafka and stream 
> "storm jar KafkaStreamMonitor --topic $kafka_topic_name --stream 
> $configured_stream_name "
> 4. Then user could start to define policy with eagle policy manager UI
> As the second step, we should allow 'developers' to define stream schema, 
> transformation and alert pipeline in very easily way, schema metadata could 
> be defined from inline / file / database (UI), as to inline/file way, the 
> framework will finally sync the stream schema into database (UI), so that 
> make sure the single source of truth.
> As the third step, we may create a never-existed experience as what you 
> described. We could allow user to define end-to-end monitoring stream 
> pipeline with UI:
> 1. DAG Builder
> 1) Set Data Source
> 2) Set Stream Schema
> 3) Define Transformation with simple method or advanced programming scripts 
> like groovy
> 4) Connect to Alert Engine
> 2. DAG Manager
> 1) Automatically build DAG
> 2) Automatically schedule DAG



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-32) Mininal General KafkaStreamMonitor

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-32.
---
Resolution: Won't Fix

> Mininal General KafkaStreamMonitor
> --
>
> Key: EAGLE-32
> URL: https://issues.apache.org/jira/browse/EAGLE-32
> Project: Eagle
>  Issue Type: Sub-task
> Environment: development
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> As the first step, we should allow traditional monitoring 'users' to
> 1. Create kafka topic say
> 2. Configure stream on UI
> 3. Start generic KafkaStreamMonitor topology pointing to the kafka and stream 
> "storm jar KafkaStreamMonitor --topic $kafka_topic_name --stream 
> $configured_stream_name "
> 4. Then user could start to define policy with eagle policy manager UI



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-20) Support Filebeat as Log Shipper for better performance

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-20.
---
Resolution: Fixed
  Assignee: Zhao, Qingwen  (was: Hao Chen)

> Support Filebeat as Log Shipper for better performance
> --
>
> Key: EAGLE-20
> URL: https://issues.apache.org/jira/browse/EAGLE-20
> Project: Eagle
>  Issue Type: New Feature
>Reporter: Hao Chen
>Assignee: Zhao, Qingwen
>
> Currently we provide two approaches for user to ship hadoop audit log from 
> local to kafka, while they have some problems for large log flow
> 1)  log4j kafka appender: impact hadoop name node stability
> 2)  logstash: consume too many machine resource like CPU/Memory
> So we may need to evaluate some other possible solutions like Elastic 
> Filebeat: https://github.com/elastic/filebeat



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-146) SiddhiExtensionLoader Error: viewing zip file for jar:./lib/ojdbc6.jar

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-146.

Resolution: Won't Fix

> SiddhiExtensionLoader Error: viewing zip file for jar:./lib/ojdbc6.jar
> --
>
> Key: EAGLE-146
> URL: https://issues.apache.org/jira/browse/EAGLE-146
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.3.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> {code}
> 2016-02-02 02:46:23 o.a.e.p.PolicyManager [INFO] Supported policy type : 
> siddhiCEPEngine
> 2016-02-02 02:46:23 o.a.e.p.PolicyManager [INFO] Supported policy type : 
> MachineLearning
> 2016-02-02 02:46:23 o.w.s.c.u.SiddhiExtensionLoader [ERROR] Error viewing zip 
> file for jar:./lib/ojdbc6.jar
> java.io.FileNotFoundException: ./lib/ojdbc6.jar (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method) ~[na:1.7.0_60]
> at java.util.zip.ZipFile.(ZipFile.java:215) ~[na:1.7.0_60]
> at java.util.zip.ZipFile.(ZipFile.java:145) ~[na:1.7.0_60]
> at java.util.zip.ZipFile.(ZipFile.java:159) ~[na:1.7.0_60]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getContentFromJarFile(SiddhiExtensionLoader.java:111)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getContent(SiddhiExtensionLoader.java:82)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getContentFromDirectory(SiddhiExtensionLoader.java:101)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getContent(SiddhiExtensionLoader.java:77)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getContentFromDirectory(SiddhiExtensionLoader.java:101)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getContent(SiddhiExtensionLoader.java:77)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.getResources(SiddhiExtensionLoader.java:71)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.util.SiddhiExtensionLoader.loadSiddhiExtensions(SiddhiExtensionLoader.java:51)
>  [stormjar.jar:na]
> at 
> org.wso2.siddhi.core.config.SiddhiContext.(SiddhiContext.java:35) 
> [stormjar.jar:na]
> at org.wso2.siddhi.core.SiddhiManager.(SiddhiManager.java:40) 
> [stormjar.jar:na]
> at 
> org.apache.eagle.policy.siddhi.SiddhiPolicyEvaluator.createSiddhiRuntime(SiddhiPolicyEvaluator.java:108)
>  [stormjar.jar:na]
> at 
> org.apache.eagle.policy.siddhi.SiddhiPolicyEvaluator.init(SiddhiPolicyEvaluator.java:83)
>  [stormjar.jar:na]
> at 
> org.apache.eagle.policy.siddhi.SiddhiPolicyEvaluator.(SiddhiPolicyEvaluator.java:79)
>  [stormjar.jar:na]
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method) [na:1.7.0_60]
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>  [na:1.7.0_60]
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>  [na:1.7.0_60]
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) 
> [na:1.7.0_60]
> at 
> org.apache.eagle.policy.executor.PolicyProcessExecutor.createPolicyEvaluator(PolicyProcessExecutor.java:243)
>  [stormjar.jar:na]
> at 
> org.apache.eagle.policy.executor.PolicyProcessExecutor.init(PolicyProcessExecutor.java:188)
>  [stormjar.jar:na]
> at 
> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
>  [stormjar.jar:na]
> at 
> backtype.storm.daemon.executor$fn__5697$fn__5710.invoke(executor.clj:732) 
> [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463) 
> [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
> 2016-02-02 02:46:23 o.w.s.c.u.SiddhiExtensionLoader [ERROR] Error viewing zip 
> file for jar:./lib/ojdbc6.jar
> java.io.FileNotFoundException: ./lib/ojdbc6.jar (No such file or directory)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-184) Migrate eagle website from https://github.com/eaglemonitoring/eaglemonitoring.github.io to document branch

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-184.

Resolution: Won't Fix

> Migrate eagle website from 
> https://github.com/eaglemonitoring/eaglemonitoring.github.io to document 
> branch
> --
>
> Key: EAGLE-184
> URL: https://issues.apache.org/jira/browse/EAGLE-184
> Project: Eagle
>  Issue Type: New Feature
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> Migrate eagle website from 
> https://github.com/eaglemonitoring/eaglemonitoring.github.io to document 
> branch



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-129) Eagle Declarative Pipeline

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-129.

Resolution: Won't Fix

> Eagle Declarative Pipeline
> --
>
> Key: EAGLE-129
> URL: https://issues.apache.org/jira/browse/EAGLE-129
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.3.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> https://cwiki.apache.org/confluence/display/EAG/Dynamical+Monitoring+Framework



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-167) Refine JMX Collector Code

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-167.

Resolution: Fixed

> Refine JMX Collector Code
> -
>
> Key: EAGLE-167
> URL: https://issues.apache.org/jira/browse/EAGLE-167
> Project: Eagle
>  Issue Type: Improvement
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> * Refactor JMX Collector to load extensions from external directory



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-181) HDFS topology alerts multiple time.

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-181.

Resolution: Fixed

> HDFS topology alerts multiple time. 
> 
>
> Key: EAGLE-181
> URL: https://issues.apache.org/jira/browse/EAGLE-181
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.3.0
>Reporter: hemanth dendukuri
>Assignee: Hao Chen
>  Labels: pre-release
>
> when I trigger an event of HDFS to create a alert 
> > hadoop fs -cat /tmp/private
> Actual 
> -
> I saw 9 alerts were create for single violation. Each alert was created in a 
> gap of minute.   
> Expected 
> -
> Only one alert should be created for single violation.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-393) Fix UnitTest Error caused by streamDef.json and TestApplicationImpl

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-393.

Resolution: Fixed

> Fix UnitTest Error caused by streamDef.json and TestApplicationImpl
> ---
>
> Key: EAGLE-393
> URL: https://issues.apache.org/jira/browse/EAGLE-393
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.4.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Fix UnitTest Error caused by streamDef.json and TestApplicationImpl



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-480) Make Hadoop jmx monitoring working in Eagle 0.5

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-480.

Resolution: Fixed

> Make Hadoop jmx monitoring working in Eagle 0.5
> ---
>
> Key: EAGLE-480
> URL: https://issues.apache.org/jira/browse/EAGLE-480
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Edward Zhang
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Hadoop jmx metrics data will go to alert engine directly, we need verify how 
> to create data source, stream and policies in Eagle 0.5



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-413) Fix Unit Test org.apache.eagle.alert.siddhi.TestExternalBatchWindow

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-413.

Resolution: Fixed

> Fix Unit Test org.apache.eagle.alert.siddhi.TestExternalBatchWindow
> ---
>
> Key: EAGLE-413
> URL: https://issues.apache.org/jira/browse/EAGLE-413
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>  Labels: unit-test
> Fix For: v0.4.0, v0.3.0
>
>
> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException: No 
> extension exist for WindowExtension{namespace='eagle'} , when creating query 
> pull76 in execution plan "1b43d978-cf66-465b-a6be-ac251025d85d"
>   at 
> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:185)
>   at 
> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
>   at 
> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:73)
>   at 
> org.apache.eagle.alert.siddhi.TestExternalBatchWindow.test07Pull76(TestExternalBatchWindow.java:170)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
>   at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>   at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>   at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>   at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>   at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
>   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
>   at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>   at org.junit.runners.Suite.runChild(Suite.java:128)
>   at org.junit.runners.Suite.runChild(Suite.java:27)
>   at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>   at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>   at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>   at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>   at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>   at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>   at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
>   at 
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:119)
>   at 
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:42)
>   at 
> com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:234)
>   at 
> com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:74)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
> Caused by: org.wso2.siddhi.core.exception.ExecutionPlanCreationException: No 
> extension exist for WindowExtension{namespace='eagle'} , when creating query 
> pull76
>   at 
> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:195)
>   at 
> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:169)
>   ... 40 more
> Caused by: org.wso2.siddhi.core.exception.ExecutionPlanCreationException: No 
> extension exist for WindowExtension{namespace='eagle'} 
>   at 
> org.wso2.siddhi.core.util.SiddhiClassLoader.loadExtensionImplementation(SiddhiClassLoader.java:67)
>   at 
> org.ws

[jira] [Resolved] (EAGLE-391) Integrate Application start/stop/status interface with TopologyMgmtResourceImpl

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-391.

Resolution: Won't Fix

> Integrate Application start/stop/status interface with 
> TopologyMgmtResourceImpl
> ---
>
> Key: EAGLE-391
> URL: https://issues.apache.org/jira/browse/EAGLE-391
> Project: Eagle
>  Issue Type: Sub-task
>Affects Versions: v0.4.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>Priority: Minor
> Fix For: v0.5.0
>
>
> Integrate Application start/stop/status interface with 
> TopologyMgmtResourceImpl



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-405) hadoopJmxMetricAlertExecutor ArrayIndexOutOfBoundsException

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-405.

Resolution: Won't Fix

> hadoopJmxMetricAlertExecutor ArrayIndexOutOfBoundsException
> ---
>
> Key: EAGLE-405
> URL: https://issues.apache.org/jira/browse/EAGLE-405
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.3.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0, v0.4.1
>
>
> {code}
> 2016-08-01T05:12:01.054+ o.a.e.p.e.PolicyProcessExecutor [ERROR] 
> hadoopJmxMetricAlertExecutor, partition 0, error fetching alerts, but 
> continue to run
> java.lang.ArrayIndexOutOfBoundsException: null
> Hope we fixed this ArrayIndexOutOfBoundException 
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-387) Implement Application Lifecycle Status Conversion

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-387.

Resolution: Fixed

> Implement Application Lifecycle Status Conversion
> -
>
> Key: EAGLE-387
> URL: https://issues.apache.org/jira/browse/EAGLE-387
> Project: Eagle
>  Issue Type: Sub-task
>Affects Versions: v0.4.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> {code}
> public static enum Status{
> INITIAILIZED("INITIAILIZED"),
> STARTING("STARTING"),
> RUNNING("RUNNING"),
> STOPPPING("STOPPPING"),
> STOPPED("STOPPED");
> private final String status;
> Status(String status){
> this.status = status;
> }
> @Override
> public String toString() {
> return status;
> }
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-233) Integrate [maven-release-plugin] for eagle release

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-233.

Resolution: Fixed

> Integrate [maven-release-plugin] for eagle release
> --
>
> Key: EAGLE-233
> URL: https://issues.apache.org/jira/browse/EAGLE-233
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.3.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>  Labels: development, tools
> Fix For: v0.5.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-459) Convert spark history using new app framework

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-459.

Resolution: Fixed

> Convert spark history using new app framework
> -
>
> Key: EAGLE-459
> URL: https://issues.apache.org/jira/browse/EAGLE-459
> Project: Eagle
>  Issue Type: Sub-task
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> Convert spark history using new app framework



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-596) Caught NoSuchFieldError when creating policy with existing policyId

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-596.

Resolution: Won't Fix

> Caught NoSuchFieldError when creating policy with existing policyId
> ---
>
> Key: EAGLE-596
> URL: https://issues.apache.org/jira/browse/EAGLE-596
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Jilin, Jiang
>Assignee: Hao Chen
>  Labels: alert-engine, alert-service, metadata
> Fix For: v0.5.0
>
>
> h2. Sample Data
> {code}
> {"name":"Mock","description":"asdadsasd","inputStreams":["hbase_audit_log_stream"],"outputStreams":["hbase_audit_log_stream"],"definition":{"type":"siddhi","value":"test","handlerClass":null,"properties":{},"inputStreams":[],"outputStreams":[]},"partitionSpec":[],"parallelismHint":2}
> {code}
> h2. NoSuchFieldError
> {code}
> WARN  [2016-10-09 09:42:35,636] org.eclipse.jetty.servlet.ServletHandler: 
> Error for /rest/metadata/policies
> ! java.lang.NoSuchFieldError: _nullProvider
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.OptimizedSettableBeanProperty._deserializeString(OptimizedSettableBeanProperty.java:168)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.SettableStringMethodProperty.deserializeAndSet(SettableStringMethodProperty.java:54)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.SuperSonicBeanDeserializer.deserializeFromObject(SuperSonicBeanDeserializer.java:226)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.SuperSonicBeanDeserializer.deserialize(SuperSonicBeanDeserializer.java:118)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:520)
>  ~[jackson-databind-2.6.6.jar:2.6.6]
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.SettableObjectMethodProperty.deserializeAndSet(SettableObjectMethodProperty.java:53)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.SuperSonicBeanDeserializer.deserializeFromObject(SuperSonicBeanDeserializer.java:226)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.module.afterburner.deser.SuperSonicBeanDeserializer.deserialize(SuperSonicBeanDeserializer.java:118)
>  ~[jackson-module-afterburner-2.3.3.jar:2.3.3]
> ! at 
> com.fasterxml.jackson.databind.ObjectReader._bind(ObjectReader.java:1470) 
> ~[jackson-databind-2.6.6.jar:2.6.6]
> ! at 
> com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912) 
> ~[jackson-databind-2.6.6.jar:2.6.6]
> ! at 
> com.fasterxml.jackson.jaxrs.base.ProviderBase.readFrom(ProviderBase.java:811) 
> ~[jackson-jaxrs-base-2.6.6.jar:2.6.6]
> ! at 
> io.dropwizard.jersey.jackson.JacksonMessageBodyProvider.readFrom(JacksonMessageBodyProvider.java:60)
>  ~[dropwizard-jersey-0.7.1.jar:0.7.1]
> ! at 
> com.sun.jersey.spi.container.ContainerRequest.getEntity(ContainerRequest.java:490)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.model.method.dispatch.EntityParamDispatchProvider$EntityInjectable.getValue(EntityParamDispatchProvider.java:123)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.inject.InjectableValuesProvider.getInjectableValues(InjectableValuesProvider.java:86)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$EntityParamInInvoker.getParams(AbstractResourceMethodDispatchProvider.java:153)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:183)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> io.dropwizard.jersey.guava.OptionalResourceMethodDispatchAdapter$OptionalRequestDispatcher.dispatch(OptionalResourceMethodDispatchAdapter.java:37)
>  ~[dropwizard-jersey-0.7.1.jar:0.7.1]
> ! at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  ~[jersey-server-1.19.1.jar:1.19.1]
> ! at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule

[jira] [Resolved] (EAGLE-613) Support modify ApplicationEntity through POST /rest/apps/{UUID}/

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-613.

Resolution: Fixed

> Support modify ApplicationEntity through POST /rest/apps/{UUID}/
> 
>
> Key: EAGLE-613
> URL: https://issues.apache.org/jira/browse/EAGLE-613
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Support modify ApplicationEntity through 
> {code}
> POST /rest/apps/{UUID}/
> {code}
> * REQUEST BODY*
> ApplicationEntity (without streams)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-639) Generate sortSpec only on externalWindow

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-639.

Resolution: Fixed

> Generate sortSpec only on externalWindow
> 
>
> Key: EAGLE-639
> URL: https://issues.apache.org/jira/browse/EAGLE-639
> Project: Eagle
>  Issue Type: Sub-task
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Generate sortSpec only on externalWindow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-654) Fix alert engine open metric system per tuple

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-654.

Resolution: Fixed

> Fix alert engine open metric system per tuple
> -
>
> Key: EAGLE-654
> URL: https://issues.apache.org/jira/browse/EAGLE-654
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Currently alert engine open metric system per tuple which will waste 
> connection and throughput:
> https://github.com/apache/incubator-eagle/blob/master/eagle-core/eagle-alert-parent/eagle-alert/alert-engine/src/main/java/org/apache/eagle/alert/engine/runner/AlertBolt.java#L131
> In order to export metric in eagle, app developer (including alert engine) 
> should never touch MetricSystem directly but  should use storm native metric 
> framework to declare and update metric, and eagle framework will 
> automatically receive metrics and export as configured.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-635.

Resolution: Fixed

> Refactor policy parser and validator for richer plan details and better 
> performance
> ---
>
> Key: EAGLE-635
> URL: https://issues.apache.org/jira/browse/EAGLE-635
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> h2. Changes
> * Refactor policy parser and validator for richer plan details and better 
> performance
> * Decouple PolicyExecutionPlan and PolicyValidation
> h2. API
> * Parse API
> {code}
> POST /metadata/policies/parse 
> Accept-Type: text
> from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select 
> cmd, user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
> {code}
> * Validation API
> {code}
> POST /metadata/policies/validate 
> Accept-Type: application/json
> {
>"name": "hdfsPolicy",
>"description": "hdfsPolicy",
>"inputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
>],
>"outputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
>],
>"definition": {
>   "type": "siddhi",
>   "value": "from 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
> user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
>},
>"partitionSpec": [
>   {
>  "streamId": "hdfs_audit_log_enriched_stream",
>  "type": "GROUPBY",
>  "columns" : [
> "cmd"
>  ]
>   }
>],
>"parallelismHint": 2
> }
> {code}
> h2. Use Cases
> * *parse*: could continuously call `parse` API aside during user keeps typing 
> to verify the syntax and automatically generate input/output/partition , as 
> it won't call back-end db, so will be very fast.
> * *validate*: when user finishes defining policy, the api will validate the 
> metadata end2end



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-647) Support Policy Execution Interpreter and Planner to compile siddhi query to distributed execution plan

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-647.

Resolution: Fixed

> Support Policy Execution Interpreter and Planner to compile siddhi query to 
> distributed execution plan
> --
>
> Key: EAGLE-647
> URL: https://issues.apache.org/jira/browse/EAGLE-647
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Support Policy Execution Interpreter and Planner to compile siddhi query to 
> distributed execution plan
> * Support parse siddhi pattern and join query as distributed execution
> * Support alias in inner join condition
> * Refactor PolicyIntepreter to eagle-alert-engine and decoupel 
> PolicyExecutionPlanner
> * Fix factory method for PolicyExecutionPlanner



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-663) Build git head COMMITID into eagle package and display in web page aside eagle version

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-663.

Resolution: Fixed

> Build git head COMMITID into eagle package and display in web page aside 
> eagle version
> --
>
> Key: EAGLE-663
> URL: https://issues.apache.org/jira/browse/EAGLE-663
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> {code}
> # Get git-head commit ID
> COMMITID=`git rev-parse HEAD`
> # Get current maven version
> VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
> --non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
> DATE=`date`
> # Generate 
> classes/assets/build-version.json
> # Access as static resource
> /build-version.json
> {
> version: "$VERSION"
> commit: "$COMMITID"
> built: "$, MacOSX, 1.8.0_74-b02"
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-711) Document JMX monitoring application

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-711.

Resolution: Fixed

> Document JMX monitoring application
> ---
>
> Key: EAGLE-711
> URL: https://issues.apache.org/jira/browse/EAGLE-711
> Project: Eagle
>  Issue Type: Task
>Reporter: jianzhong.chen
>Assignee: Hao Chen
>  Labels: docuentation
> Fix For: v0.5.0
>
>
> Application description along with:
> -  what to be monitored
> -  how to collect data, any expected impact to monitored service
> -  how to define a policy, especially on how to extract the fields from 
> stream?
> -  as much as supported policy examples
> -  latency expected for alert
> -  how to troubleshooting an application if any failure happens?
> -  ..



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-716) [API] Validate before saving policy

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-716.

Resolution: Fixed

> [API] Validate before saving policy
> ---
>
> Key: EAGLE-716
> URL: https://issues.apache.org/jira/browse/EAGLE-716
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> [API] Forcefully Validate before saving policy into metadata when calling 
> {code}
> POST /policies
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-734) Integrate maven-buildNumber-plugin and Version.java

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-734.

Resolution: Fixed

> Integrate maven-buildNumber-plugin and Version.java
> ---
>
> Key: EAGLE-734
> URL: https://issues.apache.org/jira/browse/EAGLE-734
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> * Integrate maven-buildNumber-plugin and Version.java
> * Format eagle version desc
> * Add `/server/version` and `/server/config` API



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-762) Add AlertEmailPublisherTest test cases

2016-11-10 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-762.

Resolution: Fixed

> Add AlertEmailPublisherTest test cases
> --
>
> Key: EAGLE-762
> URL: https://issues.apache.org/jira/browse/EAGLE-762
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Add AlertEmailPublisherTest test cases



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-762) Add AlertEmailPublisherTest test cases

2016-11-10 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-762:
--

 Summary: Add AlertEmailPublisherTest test cases
 Key: EAGLE-762
 URL: https://issues.apache.org/jira/browse/EAGLE-762
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Add AlertEmailPublisherTest test cases



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-581) Generate a build number when building the project.

2016-11-09 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-581.

Resolution: Duplicate

> Generate a build number when building the project.
> --
>
> Key: EAGLE-581
> URL: https://issues.apache.org/jira/browse/EAGLE-581
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Huizhi Lu
>Assignee: Huizhi Lu
> Fix For: v0.5.0
>
>
> Use case:
> we need to know what version(latest commit revision) of source code we are 
> using for the current build so that it will be convenient for us to clarify 
> different builds. So when you might make 100 builds of version 
> 0.5.0-SNAPSHOT, you can differentiate between them all.
> Solution:
> Use buildnumber-maven-plugin
> 1. Add Maven plugin buildnumber-maven-plugin to pom.xml file
> 2. Add manifest entries to META-INF/MANIFEST.MF
> Build-Branch: EAGLE-581
> Build-Commit: f6fad2ebe8a384a6d17e40c609041ff77f6a692c
> Build-Time: 2016-10-02 09:05:31 AM, UTC
> 3. Placehold VERSION.
> The build info is stored in RELEASE File in the root directory. RELEASE is 
> like:
> project.version: 0.5.0-incubating-SNAPSHOT
> build.branch: EAGLE-581
> build.commit: f6fad2ebe8a384a6d17e40c609041ff77f6a692c
> build.time: 2016-10-02 01:39:40 AM, PDT



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-734) Integrate maven-buildNumber-plugin and Version.java

2016-11-09 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-734:
---
Description: 
* Integrate maven-buildNumber-plugin and Version.java
* Format eagle version desc
* Add `/server/version` and `/server/config` API

  was:Integrate maven-buildNumber-plugin and Version.java


> Integrate maven-buildNumber-plugin and Version.java
> ---
>
> Key: EAGLE-734
> URL: https://issues.apache.org/jira/browse/EAGLE-734
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> * Integrate maven-buildNumber-plugin and Version.java
> * Format eagle version desc
> * Add `/server/version` and `/server/config` API



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-752) JPM statistic need remove jobType

2016-11-08 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-752:
---
Description: JPM statistic need remove jobType

> JPM statistic need remove jobType
> -
>
> Key: EAGLE-752
> URL: https://issues.apache.org/jira/browse/EAGLE-752
> Project: Eagle
>  Issue Type: Bug
>Reporter: Jilin, Jiang
>Assignee: Jilin, Jiang
>
> JPM statistic need remove jobType



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-750) Improve coordinator schedule strategy to reuse alert work slot

2016-11-07 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-750:
--

 Summary: Improve coordinator schedule strategy to reuse alert work 
slot
 Key: EAGLE-750
 URL: https://issues.apache.org/jira/browse/EAGLE-750
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Su Ralph
 Fix For: v0.5.0


We catch with some critical problem about alert engine policy schedule 
strategy: 

For example for an alert topology with 20 alert bolts , and after boarding 4 
policies and each assigning 5 slots, then the current alert coordinator will 
treat the work slots as used up and be unable to schedule any more new policies.

But in fact some typical eagle deployment will have at least 20+ streams with 
lots of different partition requirements, which means we could just define very 
few policies under such scheduling strategy and may waste slot resources of 
eagle’s deployment infrastructure.

In original design, we should have designed to reused slot queue among 
in-conflict monitored stream (stream-partition-sort), then eagle could try to 
reuse alert slots if possible to improve resource utilization, and  it should 
be time to implement it now.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-739) Fix eagle-metric checkstyle warnings

2016-11-06 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-739:
---
Assignee: luokun

> Fix eagle-metric checkstyle warnings
> 
>
> Key: EAGLE-739
> URL: https://issues.apache.org/jira/browse/EAGLE-739
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.4.0
>Reporter: luokun
>Assignee: luokun
> Fix For: v0.5.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Fix checkstyle problems on eagle-metric



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-740) Fix eagle-query checkstyle warnings

2016-11-06 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-740:
---
Assignee: luokun

> Fix eagle-query checkstyle warnings
> ---
>
> Key: EAGLE-740
> URL: https://issues.apache.org/jira/browse/EAGLE-740
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.4.0
>Reporter: luokun
>Assignee: luokun
> Fix For: v0.5.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Fix checkstyle problems on eagle-query



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-734) Integrate maven-buildNumber-pluginand Version.java

2016-11-04 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-734:
--

 Summary: Integrate maven-buildNumber-pluginand Version.java
 Key: EAGLE-734
 URL: https://issues.apache.org/jira/browse/EAGLE-734
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Integrate maven-buildNumber-plugin and Version.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-734) Integrate maven-buildNumber-plugin and Version.java

2016-11-04 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-734:
---
Summary: Integrate maven-buildNumber-plugin and Version.java  (was: 
Integrate maven-buildNumber-pluginand Version.java)

> Integrate maven-buildNumber-plugin and Version.java
> ---
>
> Key: EAGLE-734
> URL: https://issues.apache.org/jira/browse/EAGLE-734
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Integrate maven-buildNumber-plugin and Version.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-716) [API] Validate before saving policy

2016-11-01 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-716:
--

 Summary: [API] Validate before saving policy
 Key: EAGLE-716
 URL: https://issues.apache.org/jira/browse/EAGLE-716
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


[API] Forcefully Validate before saving policy into metadata when calling 
{code}
POST /policies
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-678) Support to configure links for site

2016-10-24 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-678:
--

 Summary: Support to configure links for site
 Key: EAGLE-678
 URL: https://issues.apache.org/jira/browse/EAGLE-678
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Support to configure links for site.

As to Hadoop, support set:
* Name Node URL
* Resource Manager URL

As to HBase, support:
* HBase master URL

Spark:
* Spark History Server URL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-677) Hadoop JMX Collector Support HA switching

2016-10-24 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-677:
--

 Summary: Hadoop JMX Collector Support HA switching
 Key: EAGLE-677
 URL: https://issues.apache.org/jira/browse/EAGLE-677
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-676) Package hadoop jmx metric collector into eagle pacakge

2016-10-24 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-676:
--

 Summary: Package hadoop jmx metric collector into eagle pacakge
 Key: EAGLE-676
 URL: https://issues.apache.org/jira/browse/EAGLE-676
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Package hadoop jmx metric collector into eagle pacakge



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-650) Hadoop JMX Metric Monitoring Application

2016-10-24 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-650.

Resolution: Fixed

> Hadoop JMX Metric Monitoring Application
> 
>
> Key: EAGLE-650
> URL: https://issues.apache.org/jira/browse/EAGLE-650
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Hadoop JMX Monitoring Application
> * Hadoop Namenode JMX
> * Hadoop Resource Manager JMX



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-665) Refactor kafka stream sink and hdfs audit topology using shuffle grouping

2016-10-23 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-665.

Resolution: Fixed

> Refactor kafka stream sink and hdfs audit topology using shuffle grouping
> -
>
> Key: EAGLE-665
> URL: https://issues.apache.org/jira/browse/EAGLE-665
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Refactor kafka stream sink and hdfs audit topology using shuffle grouping



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-669) Investigate eagle app metric system referring to https://github.com/ooyala/metrics_storm

2016-10-22 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-669:
--

 Summary: Investigate eagle app metric system referring to 
https://github.com/ooyala/metrics_storm
 Key: EAGLE-669
 URL: https://issues.apache.org/jira/browse/EAGLE-669
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
Priority: Trivial
 Fix For: v0.5.0


Investigate eagle app metric system referring to 
https://github.com/ooyala/metrics_storm



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-668) Support properties type in text area instead input field of configuration

2016-10-22 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-668:
--

 Summary: Support properties type in text area instead input field 
of configuration 
 Key: EAGLE-668
 URL: https://issues.apache.org/jira/browse/EAGLE-668
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-667) Should streat storm "KILLED" as "STOPPING" in eagle

2016-10-22 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-667:
--

 Summary: Should streat storm "KILLED" as "STOPPING" in eagle
 Key: EAGLE-667
 URL: https://issues.apache.org/jira/browse/EAGLE-667
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Should streat storm "KILLED" as "STOPPING" in eagle



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-666) Define fast compact data structure for kafka between application and alert engine

2016-10-22 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-666:
--

 Summary: Define fast compact data structure for kafka between 
application and alert engine
 Key: EAGLE-666
 URL: https://issues.apache.org/jira/browse/EAGLE-666
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Define fast compact data structure for kafka between application and alert 
engine



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-665) Refactor kafka stream sink and hdfs audit topology using shuffle grouping

2016-10-22 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-665:
--

 Summary: Refactor kafka stream sink and hdfs audit topology using 
shuffle grouping
 Key: EAGLE-665
 URL: https://issues.apache.org/jira/browse/EAGLE-665
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Refactor kafka stream sink and hdfs audit topology using shuffle grouping



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-664) Add directly updating status API to rigger update status immediately

2016-10-22 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-664:
---
Assignee: Jilin, Jiang  (was: Hao Chen)

> Add directly updating status API to rigger update status immediately
> 
>
> Key: EAGLE-664
> URL: https://issues.apache.org/jira/browse/EAGLE-664
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Jilin, Jiang
> Fix For: v0.5.0
>
>
> Add directly updating status API to rigger update status immediately, and 
> integrate with "refresh" button in front-end



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-664) Add directly updating status API to rigger update status immediately

2016-10-22 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-664:
--

 Summary: Add directly updating status API to rigger update status 
immediately
 Key: EAGLE-664
 URL: https://issues.apache.org/jira/browse/EAGLE-664
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Add directly updating status API to rigger update status immediately, and 
integrate with "refresh" button in front-end



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-663) Build git head COMMITID into eagle package and display in web page aside eagle version

2016-10-21 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-663:
---
Affects Version/s: v0.5.0
Fix Version/s: v0.5.0

> Build git head COMMITID into eagle package and display in web page aside 
> eagle version
> --
>
> Key: EAGLE-663
> URL: https://issues.apache.org/jira/browse/EAGLE-663
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> {code}
> # Get git-head commit ID
> COMMITID=`git rev-parse HEAD`
> # Get current maven version
> VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
> --non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
> DATE=`date`
> # Generate 
> classes/assets/build-version.json
> # Access as static resource
> /build-version.json
> {
> version: "$VERSION"
> commit: "$COMMITID"
> built: "$, MacOSX, 1.8.0_74-b02"
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-663) Build git head COMMITID into eagle package and display in web page aside eagle version

2016-10-21 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-663:
---
Description: 
{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`

# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
compiled: "$DATE, MacOSX, 1.8.0_74-b02"
}
{code}

  was:
{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`
# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
compiled: "$DATE, MacOSX, 1.8.0_74-b02"
}
{code}


> Build git head COMMITID into eagle package and display in web page aside 
> eagle version
> --
>
> Key: EAGLE-663
> URL: https://issues.apache.org/jira/browse/EAGLE-663
> Project: Eagle
>  Issue Type: Bug
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> {code}
> # Get git-head commit ID
> COMMITID=`git rev-parse HEAD`
> # Get current maven version
> VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
> --non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
> DATE=`date`
> # Generate 
> classes/assets/build-version.json
> # Access as static resource
> /build-version.json
> {
> version: "$VERSION"
> commit: "$COMMITID"
> compiled: "$DATE, MacOSX, 1.8.0_74-b02"
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-663) Build git head COMMITID into eagle package and display in web page aside eagle version

2016-10-21 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-663:
---
Description: 
{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`

# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
built: "$, MacOSX, 1.8.0_74-b02"
}
{code}

  was:
{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`

# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
compiled: "$DATE, MacOSX, 1.8.0_74-b02"
}
{code}


> Build git head COMMITID into eagle package and display in web page aside 
> eagle version
> --
>
> Key: EAGLE-663
> URL: https://issues.apache.org/jira/browse/EAGLE-663
> Project: Eagle
>  Issue Type: Bug
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> {code}
> # Get git-head commit ID
> COMMITID=`git rev-parse HEAD`
> # Get current maven version
> VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
> --non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
> DATE=`date`
> # Generate 
> classes/assets/build-version.json
> # Access as static resource
> /build-version.json
> {
> version: "$VERSION"
> commit: "$COMMITID"
> built: "$, MacOSX, 1.8.0_74-b02"
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-663) Build git head COMMITID into eagle package and display in web page aside eagle version

2016-10-21 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-663:
---
Description: 
{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`
# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
compiled: "$DATE, MacOSX, 1.8.0_74-b02"
}
{code}

  was:
{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`
# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
date: "$DATE"
}
{code}


> Build git head COMMITID into eagle package and display in web page aside 
> eagle version
> --
>
> Key: EAGLE-663
> URL: https://issues.apache.org/jira/browse/EAGLE-663
> Project: Eagle
>  Issue Type: Bug
>Reporter: Hao Chen
>Assignee: Hao Chen
>
> {code}
> # Get git-head commit ID
> COMMITID=`git rev-parse HEAD`
> # Get current maven version
> VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
> --non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
> DATE=`date`
> # Generate 
> classes/assets/build-version.json
> # Access as static resource
> /build-version.json
> {
> version: "$VERSION"
> commit: "$COMMITID"
> compiled: "$DATE, MacOSX, 1.8.0_74-b02"
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-663) Build git head COMMITID into eagle package and display in web page aside eagle version

2016-10-21 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-663:
--

 Summary: Build git head COMMITID into eagle package and display in 
web page aside eagle version
 Key: EAGLE-663
 URL: https://issues.apache.org/jira/browse/EAGLE-663
 Project: Eagle
  Issue Type: Bug
Reporter: Hao Chen
Assignee: Hao Chen


{code}
# Get git-head commit ID
COMMITID=`git rev-parse HEAD`
# Get current maven version
VERSION=`mvn -q -Dexec.executable="echo" -Dexec.args='${project.version}' 
--non-recursive org.codehaus.mojo:exec-maven-plugin:1.3.1:exec`
DATE=`date`

# Generate 
classes/assets/build-version.json
# Access as static resource
/build-version.json

{
version: "$VERSION"
commit: "$COMMITID"
date: "$DATE"
}
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-661) Status is wrongly shown as "INITIALIZED" when updating installed app's configuration

2016-10-21 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-661:
---
Assignee: Jilin, Jiang  (was: Hao Chen)

> Status is wrongly shown as "INITIALIZED" when updating installed app's 
> configuration
> 
>
> Key: EAGLE-661
> URL: https://issues.apache.org/jira/browse/EAGLE-661
> Project: Eagle
>  Issue Type: Bug
>Reporter: Hao Chen
>Assignee: Jilin, Jiang
> Fix For: v0.5.0
>
>
> * Status is wrongly shown as "INITIALIZED" when updating installed app's 
> configuration
> * Should use "Save" instead of "Install" button when updating installed app's 
> configuration



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-661) Status is wrongly shown as "INITIALIZED" when updating installed app's configuration

2016-10-21 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-661:
---
Description: 
* Status is wrongly shown as "INITIALIZED" when updating installed app's 
configuration
* Should use "Save" instead of "Install" button when updating installed app's 
configuration

  was:Status is wrongly shown as "INITIALIZED" when updating installed app's 
configuration


> Status is wrongly shown as "INITIALIZED" when updating installed app's 
> configuration
> 
>
> Key: EAGLE-661
> URL: https://issues.apache.org/jira/browse/EAGLE-661
> Project: Eagle
>  Issue Type: Bug
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> * Status is wrongly shown as "INITIALIZED" when updating installed app's 
> configuration
> * Should use "Save" instead of "Install" button when updating installed app's 
> configuration



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-661) Status is wrongly shown as "INITIALIZED" when updating installed app's configuration

2016-10-21 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-661:
--

 Summary: Status is wrongly shown as "INITIALIZED" when updating 
installed app's configuration
 Key: EAGLE-661
 URL: https://issues.apache.org/jira/browse/EAGLE-661
 Project: Eagle
  Issue Type: Bug
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Status is wrongly shown as "INITIALIZED" when updating installed app's 
configuration



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (EAGLE-652) services health check for hdfs,hbase and yarn

2016-10-20 Thread Hao Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/EAGLE-652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593761#comment-15593761
 ] 

Hao Chen commented on EAGLE-652:


@yulu Could you please assign the ticket to yourself?

> services health check for hdfs,hbase and yarn
> -
>
> Key: EAGLE-652
> URL: https://issues.apache.org/jira/browse/EAGLE-652
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: yupu
>  Labels: features
>
> The app aims to monitor those services with a master-slave structured 
> topology, and provides metrics at the HOST level. Specifically, this app will 
> support the following services healthy check
> •HDFS: namenode, datanode, journalnode
> •HBASE: hmaster, regionservers
> YARN: resourcemanager, nodemanagers, historyserver



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-658) Add reserved "global" siteId as shared namespace

2016-10-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-658:
--

 Summary: Add reserved "global" siteId as shared namespace
 Key: EAGLE-658
 URL: https://issues.apache.org/jira/browse/EAGLE-658
 Project: Eagle
  Issue Type: New Feature
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-657) EagleServiceMetricSink

2016-10-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-657:
--

 Summary: EagleServiceMetricSink
 Key: EAGLE-657
 URL: https://issues.apache.org/jira/browse/EAGLE-657
 Project: Eagle
  Issue Type: New Feature
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Persist metric to eagle metric store

{code}
{
metric {
   enabled: true
}
}
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-657) EagleServiceMetricSink

2016-10-20 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-657:
---
Description: 
Persist metric to eagle metric store

{code}
{
metric {
   enable: true
}
}
{code}

  was:
Persist metric to eagle metric store

{code}
{
metric {
   enabled: true
}
}
{code}


> EagleServiceMetricSink
> --
>
> Key: EAGLE-657
> URL: https://issues.apache.org/jira/browse/EAGLE-657
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Persist metric to eagle metric store
> {code}
> {
> metric {
>enable: true
> }
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-656) Integrate metric system with application framework

2016-10-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-656:
--

 Summary: Integrate metric system with application framework
 Key: EAGLE-656
 URL: https://issues.apache.org/jira/browse/EAGLE-656
 Project: Eagle
  Issue Type: Improvement
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Integrate metric system with application framework



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-654) Fix alert engine open metric system per tuple

2016-10-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-654:
--

 Summary: Fix alert engine open metric system per tuple
 Key: EAGLE-654
 URL: https://issues.apache.org/jira/browse/EAGLE-654
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Currently alert engine open metric system per tuple which will waste connection 
and throughput:
https://github.com/apache/incubator-eagle/blob/master/eagle-core/eagle-alert-parent/eagle-alert/alert-engine/src/main/java/org/apache/eagle/alert/engine/runner/AlertBolt.java#L131

In order to export metric in eagle, app developer (including alert engine) 
should never touch MetricSystem directly but  should use storm native metric 
framework to declare and update metric, and eagle framework will automatically 
receive metrics and export as configured.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (EAGLE-652) topology health check

2016-10-20 Thread Hao Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/EAGLE-652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15591519#comment-15591519
 ] 

Hao Chen commented on EAGLE-652:


[~yupu] congrats for the first contribution!

Before reviewing the PR, could you please do some modifications on the ticket 
for you to warm up eagle's community process?
* Change ticket title from "topology health check" to a more clean description
* Add some details about the ticket in the "Description"
* Add "Affect Versions" 
* Add "Labels"


> topology health check
> -
>
> Key: EAGLE-652
> URL: https://issues.apache.org/jira/browse/EAGLE-652
> Project: Eagle
>  Issue Type: New Feature
>Reporter: yupu
>
> topology health check for eagle



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-651) HBase JMX Metric Monitoring Application

2016-10-20 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-651:
---
Description: 
HBase Master JMX Monitoring
HBase Region  Server Jmx Monitoring

  was:HBase Master JMX Monitoring


> HBase JMX Metric Monitoring Application
> ---
>
> Key: EAGLE-651
> URL: https://issues.apache.org/jira/browse/EAGLE-651
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> HBase Master JMX Monitoring
> HBase Region  Server Jmx Monitoring



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-651) HBase JMX Metric Monitoring Application

2016-10-20 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-651:
---
Description: HBase Master JMX Monitoring  (was: HBase Master JMX Monitoring
HBase Region  Server Jmx Monitoring)

> HBase JMX Metric Monitoring Application
> ---
>
> Key: EAGLE-651
> URL: https://issues.apache.org/jira/browse/EAGLE-651
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> HBase Master JMX Monitoring



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-651) HBase JMX Metric Monitoring Application

2016-10-20 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-651:
--

 Summary: HBase JMX Metric Monitoring Application
 Key: EAGLE-651
 URL: https://issues.apache.org/jira/browse/EAGLE-651
 Project: Eagle
  Issue Type: New Feature
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


HBase Master JMX Monitoring



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-650) Hadoop JMX Metric Monitoring Application

2016-10-19 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-650:
---
Summary: Hadoop JMX Metric Monitoring Application  (was: Hadoop JMX 
Monitoring Application)

> Hadoop JMX Metric Monitoring Application
> 
>
> Key: EAGLE-650
> URL: https://issues.apache.org/jira/browse/EAGLE-650
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Hadoop JMX Monitoring Application
> * Hadoop Namenode JMX
> * Hadoop Resource Manager JMX



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-650) Hadoop JMX Monitoring Application

2016-10-19 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-650:
--

 Summary: Hadoop JMX Monitoring Application
 Key: EAGLE-650
 URL: https://issues.apache.org/jira/browse/EAGLE-650
 Project: Eagle
  Issue Type: New Feature
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Hadoop JMX Monitoring Application
* Hadoop Namenode JMX
* Hadoop Resource Manager JMX



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-647) Support Policy Execution Interpreter and Planner to compile siddhi query to distributed execution plan

2016-10-19 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-647:
---
Issue Type: Improvement  (was: Bug)

> Support Policy Execution Interpreter and Planner to compile siddhi query to 
> distributed execution plan
> --
>
> Key: EAGLE-647
> URL: https://issues.apache.org/jira/browse/EAGLE-647
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Support Policy Execution Interpreter and Planner to compile siddhi query to 
> distributed execution plan
> * Support parse siddhi pattern and join query as distributed execution
> * Support alias in inner join condition
> * Refactor PolicyIntepreter to eagle-alert-engine and decoupel 
> PolicyExecutionPlanner
> * Fix factory method for PolicyExecutionPlanner



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-647) Support Policy Execution Interpreter and Planner to compile siddhi query to distributed execution plan

2016-10-19 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-647:
--

 Summary: Support Policy Execution Interpreter and Planner to 
compile siddhi query to distributed execution plan
 Key: EAGLE-647
 URL: https://issues.apache.org/jira/browse/EAGLE-647
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Support Policy Execution Interpreter and Planner to compile siddhi query to 
distributed execution plan

* Support parse siddhi pattern and join query as distributed execution
* Support alias in inner join condition
* Refactor PolicyIntepreter to eagle-alert-engine and decoupel 
PolicyExecutionPlanner
* Fix factory method for PolicyExecutionPlanner



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-639) Generate sortSpec only on externalWindow

2016-10-18 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-639:
--

 Summary: Generate sortSpec only on externalWindow
 Key: EAGLE-639
 URL: https://issues.apache.org/jira/browse/EAGLE-639
 Project: Eagle
  Issue Type: Sub-task
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


Generate sortSpec only on externalWindow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-624) Installation Doc is not correctly shown in Installation Dialog

2016-10-18 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-624.

Resolution: Fixed

> Installation Doc is not correctly shown in Installation Dialog
> --
>
> Key: EAGLE-624
> URL: https://issues.apache.org/jira/browse/EAGLE-624
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>  Labels: eagle-ui
> Fix For: v0.5.0
>
>
> h2. Improvements
> * Show dependencies apps number
> * Support XML child node tree as String in app docs
> * Cleanup eagle-server dependencies and output
> * Move business logic specific logics into dev profile
> * Rename header and remove pre fo installation content
> h2. Bugs
> * Fix siteName bug in ui
> * Installation Doc is not correctly shown in Installation Dialog



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-10-18 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-635:
---
Description: 
h2. Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

h2. API
* Parse API

{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}

h2. Use Cases
* *parse*: could continuously call `parse` API aside during user keeps typing 
to verify the syntax and automatically generate input/output/partition , as it 
won't call back-end db, so will be very fast.
* *validate*: when user finishes defining policy, the api will validate the 
metadata end2end

  was:
h2. Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

h2. API
* Parse API

{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}

h2. Use Cases
* **parse**: So you could continuously call `parse` API aside during user keeps 
typing to verify the syntax and automatically generate input/output/partition , 
as it won't call back-end db, so will be very fast.
* **validate**: when user finishes defining policy, the api will validate the 
metadata end2end


> Refactor policy parser and validator for richer plan details and better 
> performance
> ---
>
> Key: EAGLE-635
> URL: https://issues.apache.org/jira/browse/EAGLE-635
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> h2. Changes
> * Refactor policy parser and validator for richer plan details and better 
> performance
> * Decouple PolicyExecutionPlan and PolicyValidation
> h2. API
> * Parse API
> {code}
> POST /metadata/policies/parse 
> Accept-Type: text
> from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select 
> cmd, user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
> {code}
> * Validation API
> {code}
> POST /metadata/policies/validate 
> Accept-Type: application/json
> {
>"name": "hdfsPolicy",
>"description": "hdfsPolicy",
>"inputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
>],
>"outputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
>],
>"definition": {
>   "type": "siddhi",
>   "value": "from 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
> user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
>},
>"partitionSpec": [
>   {
>  "streamId": "hdfs_audit_log_enriched_stream",
>  "type": "GROUPBY",
>  "columns" : [
> "cmd"
>  ]
>   }
>],
>"parallelismHint": 2
> }
> {code}
> h2. Use Cases
> * *pars

[jira] [Updated] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-10-18 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-635:
---
Description: 
h2. Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

h2. API
* Parse API

{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}

h2. Use Cases
* **parse**: So you could continuously call `parse` API aside during user keeps 
typing to verify the syntax and automatically generate input/output/partition , 
as it won't call back-end db, so will be very fast.
* **validate**: when user finishes defining policy, the api will validate the 
metadata end2end

  was:
h2. Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

h2. API
* Parse API

{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}


> Refactor policy parser and validator for richer plan details and better 
> performance
> ---
>
> Key: EAGLE-635
> URL: https://issues.apache.org/jira/browse/EAGLE-635
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> h2. Changes
> * Refactor policy parser and validator for richer plan details and better 
> performance
> * Decouple PolicyExecutionPlan and PolicyValidation
> h2. API
> * Parse API
> {code}
> POST /metadata/policies/parse 
> Accept-Type: text
> from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select 
> cmd, user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
> {code}
> * Validation API
> {code}
> POST /metadata/policies/validate 
> Accept-Type: application/json
> {
>"name": "hdfsPolicy",
>"description": "hdfsPolicy",
>"inputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
>],
>"outputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
>],
>"definition": {
>   "type": "siddhi",
>   "value": "from 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
> user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
>},
>"partitionSpec": [
>   {
>  "streamId": "hdfs_audit_log_enriched_stream",
>  "type": "GROUPBY",
>  "columns" : [
> "cmd"
>  ]
>   }
>],
>"parallelismHint": 2
> }
> {code}
> h2. Use Cases
> * **parse**: So you could continuously call `parse` API aside during user 
> keeps typing to verify the syntax and automatically generate 
> input/output/partition , as it won't call back-end db, so will be very fast.
> * **validate**: when user finishes defining policy, the api will validate the 
> metadata end2end




[jira] [Updated] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-10-18 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-635:
---
Description: 
## Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

## API
* Parse API
{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}

  was:
* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation


> Refactor policy parser and validator for richer plan details and better 
> performance
> ---
>
> Key: EAGLE-635
> URL: https://issues.apache.org/jira/browse/EAGLE-635
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> ## Changes
> * Refactor policy parser and validator for richer plan details and better 
> performance
> * Decouple PolicyExecutionPlan and PolicyValidation
> ## API
> * Parse API
> {code}
> POST /metadata/policies/parse 
> Accept-Type: text
> from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select 
> cmd, user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
> {code}
> * Validation API
> {code}
> POST /metadata/policies/validate 
> Accept-Type: application/json
> {
>"name": "hdfsPolicy",
>"description": "hdfsPolicy",
>"inputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
>],
>"outputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
>],
>"definition": {
>   "type": "siddhi",
>   "value": "from 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
> user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
>},
>"partitionSpec": [
>   {
>  "streamId": "hdfs_audit_log_enriched_stream",
>  "type": "GROUPBY",
>  "columns" : [
> "cmd"
>  ]
>   }
>],
>"parallelismHint": 2
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-10-18 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-635:
---
Description: 
h2. Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

h2. API
* Parse API

{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}

  was:
## Changes

* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation

## API
* Parse API
{code}
POST /metadata/policies/parse 
Accept-Type: text

from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
{code}

* Validation API
{code}
POST /metadata/policies/validate 
Accept-Type: application/json

{
   "name": "hdfsPolicy",
   "description": "hdfsPolicy",
   "inputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
   ],
   "outputStreams": [
  "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
   ],
   "definition": {
  "type": "siddhi",
  "value": "from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 
min) select cmd, user, count() as total_count group by cmd,user insert into 
HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
   },
   "partitionSpec": [
  {
 "streamId": "hdfs_audit_log_enriched_stream",
 "type": "GROUPBY",
 "columns" : [
"cmd"
 ]
  }
   ],
   "parallelismHint": 2
}

{code}


> Refactor policy parser and validator for richer plan details and better 
> performance
> ---
>
> Key: EAGLE-635
> URL: https://issues.apache.org/jira/browse/EAGLE-635
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> h2. Changes
> * Refactor policy parser and validator for richer plan details and better 
> performance
> * Decouple PolicyExecutionPlan and PolicyValidation
> h2. API
> * Parse API
> {code}
> POST /metadata/policies/parse 
> Accept-Type: text
> from HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select 
> cmd, user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
> {code}
> * Validation API
> {code}
> POST /metadata/policies/validate 
> Accept-Type: application/json
> {
>"name": "hdfsPolicy",
>"description": "hdfsPolicy",
>"inputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX"
>],
>"outputStreams": [
>   "HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT"
>],
>"definition": {
>   "type": "siddhi",
>   "value": "from 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX#window.timeBatch(2 min) select cmd, 
> user, count() as total_count group by cmd,user insert into 
> HDFS_AUDIT_LOG_ENRICHED_STREAM_SANDBOX_OUT "
>},
>"partitionSpec": [
>   {
>  "streamId": "hdfs_audit_log_enriched_stream",
>  "type": "GROUPBY",
>  "columns" : [
> "cmd"
>  ]
>   }
>],
>"parallelismHint": 2
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-10-18 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-635:
---
Issue Type: Improvement  (was: Bug)

> Refactor policy parser and validator for richer plan details and better 
> performance
> ---
>
> Key: EAGLE-635
> URL: https://issues.apache.org/jira/browse/EAGLE-635
> Project: Eagle
>  Issue Type: Improvement
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> * Refactor policy parser and validator for richer plan details and better 
> performance
> * Decouple PolicyExecutionPlan and PolicyValidation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (EAGLE-635) Refactor policy parser and validator for richer plan details and better performance

2016-10-18 Thread Hao Chen (JIRA)
Hao Chen created EAGLE-635:
--

 Summary: Refactor policy parser and validator for richer plan 
details and better performance
 Key: EAGLE-635
 URL: https://issues.apache.org/jira/browse/EAGLE-635
 Project: Eagle
  Issue Type: Bug
Affects Versions: v0.5.0
Reporter: Hao Chen
Assignee: Hao Chen
 Fix For: v0.5.0


* Refactor policy parser and validator for richer plan details and better 
performance
* Decouple PolicyExecutionPlan and PolicyValidation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-627) Add PolicyValidator and Validation API

2016-10-17 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-627:
---
Description: 
Add Policy PolicyValidator and Validation API on 

* Validate SiddhiQL syntax problem
* Provide Internal information like: 
* Validate syntax is ok 
* Explain details like inputStreams and outputStreams

API: 
{code}
POST /metadata/policies/validate

Request: PolicyDefinition
Response: PolicyValidation
{code}

Reference:
* 
https://github.com/apache/incubator-eagle/blob/master/eagle-core/eagle-alert-parent/eagle-alert/alert-common/src/main/java/org/apache/eagle/alert/engine/coordinator/PolicyDefinition.java
* 
https://github.com/apache/incubator-eagle/blob/master/eagle-core/eagle-alert-parent/eagle-alert/alert-metadata-parent/alert-metadata-service/src/main/java/org/apache/eagle/service/metadata/resource/PolicyValidation.java


  was:
Add Policy PolicyValidator and Validation API on 

* Validate SiddhiQL syntax problem
* Provide Internal information like: 
* Validate syntax is ok 
* Explain details like inputStreams and outputStreams

API: 
{code}
POST /metadata/policies/validate

Request: PolicyDefinition
Response: PolicyValidation
{code}



> Add PolicyValidator and Validation API
> --
>
> Key: EAGLE-627
> URL: https://issues.apache.org/jira/browse/EAGLE-627
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Add Policy PolicyValidator and Validation API on 
> * Validate SiddhiQL syntax problem
> * Provide Internal information like: 
> * Validate syntax is ok 
> * Explain details like inputStreams and outputStreams
> API: 
> {code}
> POST /metadata/policies/validate
> Request: PolicyDefinition
> Response: PolicyValidation
> {code}
> Reference:
> * 
> https://github.com/apache/incubator-eagle/blob/master/eagle-core/eagle-alert-parent/eagle-alert/alert-common/src/main/java/org/apache/eagle/alert/engine/coordinator/PolicyDefinition.java
> * 
> https://github.com/apache/incubator-eagle/blob/master/eagle-core/eagle-alert-parent/eagle-alert/alert-metadata-parent/alert-metadata-service/src/main/java/org/apache/eagle/service/metadata/resource/PolicyValidation.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-627) Add PolicyValidator and Validation API

2016-10-17 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-627:
---
Description: 
Add Policy PolicyValidator and Validation API on 

* Validate SiddhiQL syntax problem
* Provide Internal information like: 
* Validate syntax is ok 
* Explain details like inputStreams and outputStreams

API: 
{code}
POST /metadata/policies/validate

Request: PolicyDefinition
Response: PolicyValidation
{code}


  was:
Add Policy PolicyValidator and Validation API on 

* Validate SiddhiQL syntax problem
* Provide Internal information like: 
* Validate syntax is ok 
* Explain details like inputStreams and outputStreams

API: 
{code}
POST /metadata/policies/validate

Request: PolicyDefinition
{code}



> Add PolicyValidator and Validation API
> --
>
> Key: EAGLE-627
> URL: https://issues.apache.org/jira/browse/EAGLE-627
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Add Policy PolicyValidator and Validation API on 
> * Validate SiddhiQL syntax problem
> * Provide Internal information like: 
> * Validate syntax is ok 
> * Explain details like inputStreams and outputStreams
> API: 
> {code}
> POST /metadata/policies/validate
> Request: PolicyDefinition
> Response: PolicyValidation
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-627) Add PolicyValidator and Validation API

2016-10-17 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-627:
---
Description: 
Add Policy PolicyValidator and Validation API on 

* Validate SiddhiQL syntax problem
* Provide Internal information like: 
* Validate syntax is ok 
* Explain details like inputStreams and outputStreams

API: 
{code}
POST /metadata/policies/validate

Request: PolicyDefinition
{code}


  was:
Add Policy PolicyValidator and Validation API on 

* Validate SiddhiQL syntax problem
* Provide Internal information like: 
* Validate syntax is ok 
* Explain details like inputStreams and outputStreams

API: 
{code}
POST /metadata/policies/validate
{code}



> Add PolicyValidator and Validation API
> --
>
> Key: EAGLE-627
> URL: https://issues.apache.org/jira/browse/EAGLE-627
> Project: Eagle
>  Issue Type: Bug
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Add Policy PolicyValidator and Validation API on 
> * Validate SiddhiQL syntax problem
> * Provide Internal information like: 
> * Validate syntax is ok 
> * Explain details like inputStreams and outputStreams
> API: 
> {code}
> POST /metadata/policies/validate
> Request: PolicyDefinition
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (EAGLE-630) Add Publishments to Policy API

2016-10-16 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen updated EAGLE-630:
---
Labels: alert-service  (was: )

> Add Publishments to Policy API
> --
>
> Key: EAGLE-630
> URL: https://issues.apache.org/jira/browse/EAGLE-630
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>  Labels: alert-service
> Fix For: v0.5.0
>
>
> Path:
> {code}
> POST /metadata/policies/{policyId}/publishments/ 
> {code}
> Data: String array, like:
> {code}
> [
>"publishmentName1", "publishmentName2",.., "publishmentNameN"
> ]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (EAGLE-630) Add Publishments to Policy API

2016-10-16 Thread Hao Chen (JIRA)

 [ 
https://issues.apache.org/jira/browse/EAGLE-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hao Chen resolved EAGLE-630.

Resolution: Fixed

> Add Publishments to Policy API
> --
>
> Key: EAGLE-630
> URL: https://issues.apache.org/jira/browse/EAGLE-630
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
>  Labels: alert-service
> Fix For: v0.5.0
>
>
> Path:
> {code}
> POST /metadata/policies/{policyId}/publishments/ 
> {code}
> Data: String array, like:
> {code}
> [
>"publishmentName1", "publishmentName2",.., "publishmentNameN"
> ]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (EAGLE-630) Add Publishments to Policy API

2016-10-16 Thread Hao Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/EAGLE-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581298#comment-15581298
 ] 

Hao Chen commented on EAGLE-630:


[~smith3816]

> Add Publishments to Policy API
> --
>
> Key: EAGLE-630
> URL: https://issues.apache.org/jira/browse/EAGLE-630
> Project: Eagle
>  Issue Type: New Feature
>Affects Versions: v0.5.0
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: v0.5.0
>
>
> Path:
> {code}
> POST /metadata/policies/{policyId}/publishments/ 
> {code}
> Data: String array, like:
> {code}
> [
>"publishmentName1", "publishmentName2",.., "publishmentNameN"
> ]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


  1   2   3   4   5   6   7   8   9   10   >