[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-22 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
Issues resolved, hence closing it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-21 Thread haoch
Github user haoch commented on the issue:

https://github.com/apache/eagle/pull/796
  
@DadanielZ is this PR still valid?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-16 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
@qingwen220 sure, will do it.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-15 Thread qingwen220
Github user qingwen220 commented on the issue:

https://github.com/apache/eagle/pull/796
  
@DadanielZ Could you help to fix it? I have a ticket here 
https://issues.apache.org/jira/browse/EAGLE-902


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-13 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
@qingwen220 Got it.. When will we add this module and what is the target 
release date for Eagle 0.5?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-12 Thread qingwen220
Github user qingwen220 commented on the issue:

https://github.com/apache/eagle/pull/796
  
Hi @DadanielZ,

We have not added this module into Eagle server. So the service loader 
cannot detect it. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-10 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
@wujinhu thanks 👍 , this issue is solved.

But I come up with another one when tring to view the alerts from UI:

After configuring the "application-debug.conf" properly with *"jdbc"* as 
the storage type, I started eagle from Intellij successfully and started 
alert-engine and hdfsAuditLogApp smoothly, then I created a hdfs policy.

I saw alerts are generated and saved in my mysql database. 

But when I tried to view the alerts from UI, ERROR occurs:
~~~
ERROR [2017-02-10 01:19:40,433] 
org.apache.eagle.service.generic.GenericEntityServiceResource: unknown storage 
type: jdbc, support: [hbase]
! org.apache.eagle.storage.exception.IllegalDataStorageTypeException: 
unknown storage type: jdbc, support: [hbase]
~~~

During debugging I see `storageServiceProviders` only contains 
`hBaseStorage`, but no `jdbcStorage`. Could you tell me the reason or give me a 
hint on which module to look into? 

Thanks and regards,
Da

 Here is the configuration file I used:

~~~
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

# -
# Eagle REST Web Service Configuration
# -
service {
  env = "testing"
  host = "localhost"
  port = 9090
  username = "admin"
  password = "secret"
  readTimeOutSeconds = 60
  context = "/rest"
  timezone = "UTC"
}

zookeeper {
  zkQuorum = "localhost:2181"
  zkSessionTimeoutMs : 15000
  zkRetryTimes : 3
  zkRetryInterval : 2
}

# -
# Eagle Deep Storage Configuration
# -

storage {
  type = "jdbc"
  jdbc {
adapter = "mysql"
username = "root"
password = root
database = eagle
connectionUrl = "jdbc:mysql://localhost:3306/eagle"
connectionProps = "encoding=UTF-8"
driverClass = "com.mysql.jdbc.Driver"
connectionMax = 8
  }
}

# -
# Eagle Metadata Store Configuration
# -


metadata {
  store = "org.apache.eagle.metadata.store.jdbc.JDBCMetadataStore"
  jdbc {
username = root
password = root
driverClassName = com.mysql.jdbc.Driver
database = "eagle"
connection = "jdbc:mysql://localhost:3306/eagle?user=root"
  }
}
# -
# Eagle Application Configuration
# -
application {
  stream {
provider = org.apache.eagle.app.messaging.KafkaStreamProvider
  }
  storm {
nimbusHost = "localhost"
nimbusThriftPort = 6627
  }
  updateStatus: {
initialDelay: 10
period: 10
  }
  healthCheck {
initialDelay = 30
period = 60
publisher {
  publisherImpl = 
org.apache.eagle.app.service.impl.ApplicationHealthCheckEmailPublisher
  dailySendHour = 11
  mail.smtp.host = "mail.host.com"
  mail.smtp.port = 25
  mail.smtp.recipients = "some...@email.com"
  mail.smtp.subject = "Eagle Application Health Check"
  mail.smtp.template = "HealthCheckTemplate.vm"
}
  }
  mailService {
mailSmtpServer = "",
mailSmtpPort = 25,
mailSmtpAuth = "false"
//mailSmtpConn = "plaintext",
//mailSmtpUsername = ""
//mailSmtpPassword = ""
//mailSmtpDebug = false
  }
  dailyJobReport {
reportHourTime: 1
reportPeriodInHour: 12
numTopUsers : 10
jobOvertimeLimitInHour: 6
subject: "Job Report For 12 hours"
recipients: "nob...@abc.com"
template: "JobReportTemplate.vm"
  }
}

# -
# Eagle Alert Engine Configuration
# ---

[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-08 Thread wujinhu
Github user wujinhu commented on the issue:

https://github.com/apache/eagle/pull/796
  
@DadanielZ I think you can add application-debug.conf to 
eagle-server/src/test/resources/ if you run Class ServerDebug. Pls have a try. 
Thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-08 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
@wujinhu I  see,  so this only happens in dev env.  Since "Typesafe Config" 
is loading all "applicaiton.conf" in the classPath, parameters like "siteId", 
"appId",etc are preloaded in "server config". 

Is there a good way to solve this issue? Or I have to update all 
"application.conf" files in the maven project manually?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-08 Thread wujinhu
Github user wujinhu commented on the issue:

https://github.com/apache/eagle/pull/796
  
IMO, "server config" has "siteId = testSite", "appId = HBaseAuditLog" may 
be wrong. It should not contains these. I mean wrong application.conf has been 
loaded probably. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-07 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
@wujinhu here is what I observed:
1. In site "sandbox", I have "alert engine" started. In storm UI, topology 
is running as "HBaseAuditMonitor"
2.When run in Debug mode in Intellij, "server config"  has "siteId = 
testSite", "appId = HBaseAuditLog", and config context has "siteId = sandbox" 
and  "appId = ALERT_UNIT_TOPOLOGY_APP_SANDBOX".
Because server config has higher priority, these context info are 
overridden.

By the way, could you explain a little bit on "There are a lot of 
application.conf files in eagle. I think this is the root cause"?

Thanks and regards,
Da


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-07 Thread wujinhu
Github user wujinhu commented on the issue:

https://github.com/apache/eagle/pull/796
  
@DadanielZ 
There are a lot of application.conf files in eagle. I think this is the 
root cause.
Besides, I think server config has higher priority than generated 
config(context)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-07 Thread DadanielZ
Github user DadanielZ commented on the issue:

https://github.com/apache/eagle/pull/796
  
@wujinhu yes, I find this when I start eagle from Intellij on mac.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-07 Thread wujinhu
Github user wujinhu commented on the issue:

https://github.com/apache/eagle/pull/796
  
@DadanielZ Do you find this problem in your dev env?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] eagle issue #796: [EAGLE-888] Application submitted to Storm is always shown...

2017-02-07 Thread haoch
Github user haoch commented on the issue:

https://github.com/apache/eagle/pull/796
  
@wujinhu please help review the PR about app/server config changes


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---