[
https://issues.apache.org/jira/browse/EAGLE-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhao, Qingwen updated EAGLE-592:
--------------------------------
Description:
In Hdfs audit log application, the default deserializer class configured in
Eagle is "storm.kafka.StringScheme", which only processes the raw log
{code}
"dataSourceConfig": {
...
"schemeCls" : "storm.kafka.StringScheme"
},
{code}
For some log collector agents, like filebeat (5.0), the output is in json
format.
{"xx": "abc", "yy": "aabbcc", "message": "audit log"}
This ticket will create a class MessageJsonScheme which will extract 'message'
field from the message from Kafka
was:
For some log collector agents, like filebeat (5.0), the output is in json
format.
{"xx": "abc", "yy": "aabbcc", "message": "audit log"}
This ticket will create a class MessageJsonScheme which will extract 'message'
field from the message from Kafka
> Add a hdfs audit log parser which consumes message in Json format
> -----------------------------------------------------------------
>
> Key: EAGLE-592
> URL: https://issues.apache.org/jira/browse/EAGLE-592
> Project: Eagle
> Issue Type: Improvement
> Affects Versions: v0.5.0
> Reporter: Zhao, Qingwen
> Assignee: Zhao, Qingwen
> Fix For: v0.5.0
>
>
> In Hdfs audit log application, the default deserializer class configured in
> Eagle is "storm.kafka.StringScheme", which only processes the raw log
> {code}
> "dataSourceConfig": {
> ...
> "schemeCls" : "storm.kafka.StringScheme"
> },
> {code}
> For some log collector agents, like filebeat (5.0), the output is in json
> format.
> {"xx": "abc", "yy": "aabbcc", "message": "audit log"}
> This ticket will create a class MessageJsonScheme which will extract
> 'message' field from the message from Kafka
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
